------------------->Evaluating SGD <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.0634 - acc: 0.4276 - val_loss: 0.0283 - val_acc: 0.6425
Epoch 00001: val_loss improved from inf to 0.02830, saving model to my_model_SGD.h5
Epoch 2/80
1712/1712 [==============================] - 1s 423us/step - loss: 0.0338 - acc: 0.4264 - val_loss: 0.0169 - val_acc: 0.5631
Epoch 00002: val_loss improved from 0.02830 to 0.01691, saving model to my_model_SGD.h5
Epoch 3/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0260 - acc: 0.4591 - val_loss: 0.0122 - val_acc: 0.6589
Epoch 00003: val_loss improved from 0.01691 to 0.01223, saving model to my_model_SGD.h5
Epoch 4/80
1712/1712 [==============================] - 1s 430us/step - loss: 0.0227 - acc: 0.4690 - val_loss: 0.0105 - val_acc: 0.6799
Epoch 00004: val_loss improved from 0.01223 to 0.01054, saving model to my_model_SGD.h5
Epoch 5/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0200 - acc: 0.5082 - val_loss: 0.0094 - val_acc: 0.6846
Epoch 00005: val_loss improved from 0.01054 to 0.00944, saving model to my_model_SGD.h5
Epoch 6/80
1712/1712 [==============================] - 1s 427us/step - loss: 0.0187 - acc: 0.4982 - val_loss: 0.0084 - val_acc: 0.6869
Epoch 00006: val_loss improved from 0.00944 to 0.00844, saving model to my_model_SGD.h5
Epoch 7/80
1712/1712 [==============================] - 1s 425us/step - loss: 0.0177 - acc: 0.5053 - val_loss: 0.0078 - val_acc: 0.6846
Epoch 00007: val_loss improved from 0.00844 to 0.00780, saving model to my_model_SGD.h5
Epoch 8/80
1712/1712 [==============================] - 1s 422us/step - loss: 0.0166 - acc: 0.4883 - val_loss: 0.0070 - val_acc: 0.6893
Epoch 00008: val_loss improved from 0.00780 to 0.00695, saving model to my_model_SGD.h5
Epoch 9/80
1712/1712 [==============================] - 1s 410us/step - loss: 0.0153 - acc: 0.5275 - val_loss: 0.0071 - val_acc: 0.6893
Epoch 00009: val_loss did not improve
Epoch 10/80
1712/1712 [==============================] - 1s 420us/step - loss: 0.0150 - acc: 0.5099 - val_loss: 0.0069 - val_acc: 0.6893
Epoch 00010: val_loss improved from 0.00695 to 0.00685, saving model to my_model_SGD.h5
Epoch 11/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0144 - acc: 0.5006 - val_loss: 0.0064 - val_acc: 0.6893
Epoch 00011: val_loss improved from 0.00685 to 0.00637, saving model to my_model_SGD.h5
Epoch 12/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0136 - acc: 0.5117 - val_loss: 0.0063 - val_acc: 0.6893
Epoch 00012: val_loss improved from 0.00637 to 0.00633, saving model to my_model_SGD.h5
Epoch 13/80
1712/1712 [==============================] - 1s 418us/step - loss: 0.0132 - acc: 0.5134 - val_loss: 0.0057 - val_acc: 0.6893
Epoch 00013: val_loss improved from 0.00633 to 0.00574, saving model to my_model_SGD.h5
Epoch 14/80
1712/1712 [==============================] - 1s 424us/step - loss: 0.0127 - acc: 0.5175 - val_loss: 0.0056 - val_acc: 0.6893
Epoch 00014: val_loss improved from 0.00574 to 0.00559, saving model to my_model_SGD.h5
Epoch 15/80
1712/1712 [==============================] - 1s 425us/step - loss: 0.0125 - acc: 0.5029 - val_loss: 0.0057 - val_acc: 0.6916
Epoch 00015: val_loss did not improve
Epoch 16/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0119 - acc: 0.5216 - val_loss: 0.0053 - val_acc: 0.6916
Epoch 00016: val_loss improved from 0.00559 to 0.00525, saving model to my_model_SGD.h5
Epoch 17/80
1712/1712 [==============================] - 1s 420us/step - loss: 0.0120 - acc: 0.5158 - val_loss: 0.0055 - val_acc: 0.6939
Epoch 00017: val_loss did not improve
Epoch 18/80
1712/1712 [==============================] - 1s 421us/step - loss: 0.0116 - acc: 0.5228 - val_loss: 0.0052 - val_acc: 0.6916
Epoch 00018: val_loss improved from 0.00525 to 0.00520, saving model to my_model_SGD.h5
Epoch 19/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0114 - acc: 0.5298 - val_loss: 0.0051 - val_acc: 0.6916
Epoch 00019: val_loss improved from 0.00520 to 0.00505, saving model to my_model_SGD.h5
Epoch 20/80
1712/1712 [==============================] - 1s 425us/step - loss: 0.0111 - acc: 0.5321 - val_loss: 0.0049 - val_acc: 0.6916
Epoch 00020: val_loss improved from 0.00505 to 0.00492, saving model to my_model_SGD.h5
Epoch 21/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0107 - acc: 0.5327 - val_loss: 0.0051 - val_acc: 0.6916
Epoch 00021: val_loss did not improve
Epoch 22/80
1712/1712 [==============================] - 1s 433us/step - loss: 0.0105 - acc: 0.5304 - val_loss: 0.0049 - val_acc: 0.6916
Epoch 00022: val_loss did not improve
Epoch 23/80
1712/1712 [==============================] - 1s 412us/step - loss: 0.0107 - acc: 0.5251 - val_loss: 0.0048 - val_acc: 0.6916
Epoch 00023: val_loss improved from 0.00492 to 0.00475, saving model to my_model_SGD.h5
Epoch 24/80
1712/1712 [==============================] - 1s 410us/step - loss: 0.0102 - acc: 0.5333 - val_loss: 0.0048 - val_acc: 0.6916
Epoch 00024: val_loss did not improve
Epoch 25/80
1712/1712 [==============================] - 1s 413us/step - loss: 0.0102 - acc: 0.5543 - val_loss: 0.0049 - val_acc: 0.6916
Epoch 00025: val_loss did not improve
Epoch 26/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0099 - acc: 0.5315 - val_loss: 0.0048 - val_acc: 0.6916
Epoch 00026: val_loss did not improve
Epoch 27/80
1712/1712 [==============================] - 1s 431us/step - loss: 0.0099 - acc: 0.5456 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00027: val_loss improved from 0.00475 to 0.00464, saving model to my_model_SGD.h5
Epoch 28/80
1712/1712 [==============================] - 1s 413us/step - loss: 0.0099 - acc: 0.5210 - val_loss: 0.0047 - val_acc: 0.6916
Epoch 00028: val_loss did not improve
Epoch 29/80
1712/1712 [==============================] - 1s 426us/step - loss: 0.0096 - acc: 0.5228 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00029: val_loss improved from 0.00464 to 0.00460, saving model to my_model_SGD.h5
Epoch 30/80
1712/1712 [==============================] - 1s 425us/step - loss: 0.0096 - acc: 0.5438 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00030: val_loss did not improve
Epoch 31/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0094 - acc: 0.5508 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00031: val_loss did not improve
Epoch 32/80
1712/1712 [==============================] - 1s 415us/step - loss: 0.0094 - acc: 0.5409 - val_loss: 0.0047 - val_acc: 0.6916
Epoch 00032: val_loss did not improve
Epoch 33/80
1712/1712 [==============================] - 1s 424us/step - loss: 0.0092 - acc: 0.5450 - val_loss: 0.0047 - val_acc: 0.6916
Epoch 00033: val_loss did not improve
Epoch 34/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0091 - acc: 0.5584 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00034: val_loss improved from 0.00460 to 0.00455, saving model to my_model_SGD.h5
Epoch 35/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0092 - acc: 0.5572 - val_loss: 0.0047 - val_acc: 0.6916
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0090 - acc: 0.5572 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00036: val_loss did not improve
Epoch 37/80
1712/1712 [==============================] - 1s 413us/step - loss: 0.0090 - acc: 0.5350 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00037: val_loss improved from 0.00455 to 0.00448, saving model to my_model_SGD.h5
Epoch 38/80
1712/1712 [==============================] - 1s 421us/step - loss: 0.0089 - acc: 0.5526 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00038: val_loss did not improve
Epoch 39/80
1712/1712 [==============================] - 1s 408us/step - loss: 0.0086 - acc: 0.5578 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00039: val_loss did not improve
Epoch 40/80
1712/1712 [==============================] - 1s 411us/step - loss: 0.0089 - acc: 0.5613 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 421us/step - loss: 0.0088 - acc: 0.5572 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00041: val_loss did not improve
Epoch 42/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0084 - acc: 0.5648 - val_loss: 0.0046 - val_acc: 0.6916
Epoch 00042: val_loss did not improve
Epoch 43/80
1712/1712 [==============================] - 1s 418us/step - loss: 0.0085 - acc: 0.5537 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00043: val_loss improved from 0.00448 to 0.00444, saving model to my_model_SGD.h5
Epoch 44/80
1712/1712 [==============================] - 1s 423us/step - loss: 0.0083 - acc: 0.5730 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00044: val_loss did not improve
Epoch 45/80
1712/1712 [==============================] - 1s 420us/step - loss: 0.0083 - acc: 0.5672 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00045: val_loss did not improve
Epoch 46/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0086 - acc: 0.5596 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00046: val_loss did not improve
Epoch 47/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0082 - acc: 0.5864 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00047: val_loss did not improve
Epoch 48/80
1712/1712 [==============================] - 1s 407us/step - loss: 0.0082 - acc: 0.5543 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00048: val_loss did not improve
Epoch 49/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0082 - acc: 0.5718 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00049: val_loss did not improve
Epoch 50/80
1712/1712 [==============================] - 1s 407us/step - loss: 0.0081 - acc: 0.5619 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00050: val_loss improved from 0.00444 to 0.00439, saving model to my_model_SGD.h5
Epoch 51/80
1712/1712 [==============================] - 1s 418us/step - loss: 0.0083 - acc: 0.5532 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00051: val_loss did not improve
Epoch 52/80
1712/1712 [==============================] - 1s 415us/step - loss: 0.0081 - acc: 0.5660 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00052: val_loss improved from 0.00439 to 0.00438, saving model to my_model_SGD.h5
Epoch 53/80
1712/1712 [==============================] - 1s 417us/step - loss: 0.0079 - acc: 0.5824 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00053: val_loss improved from 0.00438 to 0.00434, saving model to my_model_SGD.h5
Epoch 54/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0081 - acc: 0.5870 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00054: val_loss improved from 0.00434 to 0.00432, saving model to my_model_SGD.h5
Epoch 55/80
1712/1712 [==============================] - 1s 434us/step - loss: 0.0080 - acc: 0.5695 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00055: val_loss did not improve
Epoch 56/80
1712/1712 [==============================] - 1s 431us/step - loss: 0.0078 - acc: 0.5555 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00056: val_loss did not improve
Epoch 57/80
1712/1712 [==============================] - 1s 420us/step - loss: 0.0078 - acc: 0.5771 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00057: val_loss improved from 0.00432 to 0.00425, saving model to my_model_SGD.h5
Epoch 58/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0079 - acc: 0.5561 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00058: val_loss did not improve
Epoch 59/80
1712/1712 [==============================] - 1s 406us/step - loss: 0.0078 - acc: 0.5794 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 421us/step - loss: 0.0078 - acc: 0.5759 - val_loss: 0.0045 - val_acc: 0.6916
Epoch 00060: val_loss did not improve
Epoch 61/80
1712/1712 [==============================] - 1s 425us/step - loss: 0.0077 - acc: 0.5765 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00061: val_loss did not improve
Epoch 62/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0076 - acc: 0.5800 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00062: val_loss did not improve
Epoch 63/80
1712/1712 [==============================] - 1s 415us/step - loss: 0.0076 - acc: 0.5859 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00063: val_loss did not improve
Epoch 64/80
1712/1712 [==============================] - 1s 421us/step - loss: 0.0075 - acc: 0.5935 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00064: val_loss improved from 0.00425 to 0.00422, saving model to my_model_SGD.h5
Epoch 65/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0077 - acc: 0.5660 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00065: val_loss did not improve
Epoch 66/80
1712/1712 [==============================] - 1s 417us/step - loss: 0.0074 - acc: 0.6075 - val_loss: 0.0044 - val_acc: 0.6916
Epoch 00066: val_loss did not improve
Epoch 67/80
1712/1712 [==============================] - 1s 419us/step - loss: 0.0076 - acc: 0.5929 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00067: val_loss did not improve
Epoch 68/80
1712/1712 [==============================] - 1s 426us/step - loss: 0.0076 - acc: 0.5783 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0075 - acc: 0.5812 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00069: val_loss did not improve
Epoch 70/80
1712/1712 [==============================] - 1s 426us/step - loss: 0.0072 - acc: 0.5905 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00070: val_loss improved from 0.00422 to 0.00420, saving model to my_model_SGD.h5
Epoch 71/80
1712/1712 [==============================] - 1s 415us/step - loss: 0.0074 - acc: 0.5958 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00071: val_loss did not improve
Epoch 72/80
1712/1712 [==============================] - 1s 415us/step - loss: 0.0073 - acc: 0.5923 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00072: val_loss did not improve
Epoch 73/80
1712/1712 [==============================] - 1s 417us/step - loss: 0.0073 - acc: 0.5824 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00073: val_loss did not improve
Epoch 74/80
1712/1712 [==============================] - 1s 421us/step - loss: 0.0072 - acc: 0.5847 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 420us/step - loss: 0.0073 - acc: 0.5958 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00075: val_loss did not improve
Epoch 76/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0073 - acc: 0.5970 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00076: val_loss improved from 0.00420 to 0.00417, saving model to my_model_SGD.h5
Epoch 77/80
1712/1712 [==============================] - 1s 414us/step - loss: 0.0071 - acc: 0.5888 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00077: val_loss did not improve
Epoch 78/80
1712/1712 [==============================] - 1s 416us/step - loss: 0.0072 - acc: 0.5993 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00078: val_loss did not improve
Epoch 79/80
1712/1712 [==============================] - 1s 424us/step - loss: 0.0071 - acc: 0.5894 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00079: val_loss did not improve
Epoch 80/80
1712/1712 [==============================] - 1s 428us/step - loss: 0.0071 - acc: 0.5730 - val_loss: 0.0042 - val_acc: 0.6916
Epoch 00080: val_loss did not improve
------------------->Evaluating RMSprop <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.0417 - acc: 0.3551 - val_loss: 0.0091 - val_acc: 0.6963
Epoch 00001: val_loss improved from inf to 0.00905, saving model to my_model_RMSprop.h5
Epoch 2/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0118 - acc: 0.5064 - val_loss: 0.0161 - val_acc: 0.6963
Epoch 00002: val_loss did not improve
Epoch 3/80
1712/1712 [==============================] - 1s 446us/step - loss: 0.0081 - acc: 0.5765 - val_loss: 0.0044 - val_acc: 0.6963
Epoch 00003: val_loss improved from 0.00905 to 0.00444, saving model to my_model_RMSprop.h5
Epoch 4/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0067 - acc: 0.6075 - val_loss: 0.0041 - val_acc: 0.6986
Epoch 00004: val_loss improved from 0.00444 to 0.00410, saving model to my_model_RMSprop.h5
Epoch 5/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0056 - acc: 0.6542 - val_loss: 0.0063 - val_acc: 0.6986
Epoch 00005: val_loss did not improve
Epoch 6/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0049 - acc: 0.6706 - val_loss: 0.0069 - val_acc: 0.6589
Epoch 00006: val_loss did not improve
Epoch 7/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0044 - acc: 0.6764 - val_loss: 0.0028 - val_acc: 0.6729
Epoch 00007: val_loss improved from 0.00410 to 0.00281, saving model to my_model_RMSprop.h5
Epoch 8/80
1712/1712 [==============================] - 1s 447us/step - loss: 0.0040 - acc: 0.6624 - val_loss: 0.0027 - val_acc: 0.7079
Epoch 00008: val_loss improved from 0.00281 to 0.00270, saving model to my_model_RMSprop.h5
Epoch 9/80
1712/1712 [==============================] - 1s 430us/step - loss: 0.0036 - acc: 0.6910 - val_loss: 0.0026 - val_acc: 0.7196
Epoch 00009: val_loss improved from 0.00270 to 0.00259, saving model to my_model_RMSprop.h5
Epoch 10/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0034 - acc: 0.7009 - val_loss: 0.0026 - val_acc: 0.6939
Epoch 00010: val_loss improved from 0.00259 to 0.00257, saving model to my_model_RMSprop.h5
Epoch 11/80
1712/1712 [==============================] - 1s 435us/step - loss: 0.0030 - acc: 0.7225 - val_loss: 0.0036 - val_acc: 0.6963
Epoch 00011: val_loss did not improve
Epoch 12/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0030 - acc: 0.6945 - val_loss: 0.0021 - val_acc: 0.7079
Epoch 00012: val_loss improved from 0.00257 to 0.00212, saving model to my_model_RMSprop.h5
Epoch 13/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0028 - acc: 0.7261 - val_loss: 0.0024 - val_acc: 0.7103
Epoch 00013: val_loss did not improve
Epoch 14/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0025 - acc: 0.7144 - val_loss: 0.0019 - val_acc: 0.7150
Epoch 00014: val_loss improved from 0.00212 to 0.00188, saving model to my_model_RMSprop.h5
Epoch 15/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0024 - acc: 0.7167 - val_loss: 0.0022 - val_acc: 0.7079
Epoch 00015: val_loss did not improve
Epoch 16/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0022 - acc: 0.7261 - val_loss: 0.0022 - val_acc: 0.7079
Epoch 00016: val_loss did not improve
Epoch 17/80
1712/1712 [==============================] - 1s 449us/step - loss: 0.0021 - acc: 0.7407 - val_loss: 0.0017 - val_acc: 0.7243
Epoch 00017: val_loss improved from 0.00188 to 0.00173, saving model to my_model_RMSprop.h5
Epoch 18/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0020 - acc: 0.7436 - val_loss: 0.0024 - val_acc: 0.7243
Epoch 00018: val_loss did not improve
Epoch 19/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0019 - acc: 0.7383 - val_loss: 0.0016 - val_acc: 0.7313
Epoch 00019: val_loss improved from 0.00173 to 0.00158, saving model to my_model_RMSprop.h5
Epoch 20/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0018 - acc: 0.7576 - val_loss: 0.0025 - val_acc: 0.7150
Epoch 00020: val_loss did not improve
Epoch 21/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0017 - acc: 0.7617 - val_loss: 0.0016 - val_acc: 0.7640
Epoch 00021: val_loss improved from 0.00158 to 0.00155, saving model to my_model_RMSprop.h5
Epoch 22/80
1712/1712 [==============================] - 1s 432us/step - loss: 0.0016 - acc: 0.7675 - val_loss: 0.0014 - val_acc: 0.7617
Epoch 00022: val_loss improved from 0.00155 to 0.00137, saving model to my_model_RMSprop.h5
Epoch 23/80
1712/1712 [==============================] - 1s 446us/step - loss: 0.0015 - acc: 0.7699 - val_loss: 0.0013 - val_acc: 0.7687
Epoch 00023: val_loss improved from 0.00137 to 0.00133, saving model to my_model_RMSprop.h5
Epoch 24/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0014 - acc: 0.7716 - val_loss: 0.0014 - val_acc: 0.7593
Epoch 00024: val_loss did not improve
Epoch 25/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0014 - acc: 0.7821 - val_loss: 0.0016 - val_acc: 0.7664
Epoch 00025: val_loss did not improve
Epoch 26/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0014 - acc: 0.7745 - val_loss: 0.0013 - val_acc: 0.7547
Epoch 00026: val_loss did not improve
Epoch 27/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0012 - acc: 0.7868 - val_loss: 0.0015 - val_acc: 0.7710
Epoch 00027: val_loss did not improve
Epoch 28/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0012 - acc: 0.7821 - val_loss: 0.0013 - val_acc: 0.7710
Epoch 00028: val_loss improved from 0.00133 to 0.00126, saving model to my_model_RMSprop.h5
Epoch 29/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0011 - acc: 0.7874 - val_loss: 0.0014 - val_acc: 0.7804
Epoch 00029: val_loss did not improve
Epoch 30/80
1712/1712 [==============================] - 1s 465us/step - loss: 0.0011 - acc: 0.7979 - val_loss: 0.0014 - val_acc: 0.7593
Epoch 00030: val_loss did not improve
Epoch 31/80
1712/1712 [==============================] - 1s 453us/step - loss: 0.0011 - acc: 0.7897 - val_loss: 0.0012 - val_acc: 0.7710
Epoch 00031: val_loss improved from 0.00126 to 0.00119, saving model to my_model_RMSprop.h5
Epoch 32/80
1712/1712 [==============================] - 1s 456us/step - loss: 0.0010 - acc: 0.7991 - val_loss: 0.0013 - val_acc: 0.7664
Epoch 00032: val_loss did not improve
Epoch 33/80
1712/1712 [==============================] - 1s 462us/step - loss: 0.0010 - acc: 0.8061 - val_loss: 0.0012 - val_acc: 0.7850
Epoch 00033: val_loss did not improve
Epoch 34/80
1712/1712 [==============================] - 1s 426us/step - loss: 9.8931e-04 - acc: 0.8102 - val_loss: 0.0012 - val_acc: 0.7640
Epoch 00034: val_loss did not improve
Epoch 35/80
1712/1712 [==============================] - 1s 439us/step - loss: 9.7327e-04 - acc: 0.8207 - val_loss: 0.0012 - val_acc: 0.7804
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 454us/step - loss: 9.4467e-04 - acc: 0.8014 - val_loss: 0.0013 - val_acc: 0.7664
Epoch 00036: val_loss did not improve
Epoch 37/80
1712/1712 [==============================] - 1s 448us/step - loss: 9.0403e-04 - acc: 0.8037 - val_loss: 0.0012 - val_acc: 0.7710
Epoch 00037: val_loss improved from 0.00119 to 0.00118, saving model to my_model_RMSprop.h5
Epoch 38/80
1712/1712 [==============================] - 1s 455us/step - loss: 9.1130e-04 - acc: 0.8125 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00038: val_loss improved from 0.00118 to 0.00113, saving model to my_model_RMSprop.h5
Epoch 39/80
1712/1712 [==============================] - 1s 458us/step - loss: 8.8493e-04 - acc: 0.8096 - val_loss: 0.0012 - val_acc: 0.7710
Epoch 00039: val_loss did not improve
Epoch 40/80
1712/1712 [==============================] - 1s 440us/step - loss: 8.5503e-04 - acc: 0.8090 - val_loss: 0.0012 - val_acc: 0.7967
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 448us/step - loss: 8.5498e-04 - acc: 0.8172 - val_loss: 0.0011 - val_acc: 0.7757
Epoch 00041: val_loss did not improve
Epoch 42/80
1712/1712 [==============================] - 1s 453us/step - loss: 8.2676e-04 - acc: 0.8294 - val_loss: 0.0012 - val_acc: 0.7850
Epoch 00042: val_loss did not improve
Epoch 43/80
1712/1712 [==============================] - 1s 444us/step - loss: 8.4299e-04 - acc: 0.8201 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00043: val_loss did not improve
Epoch 44/80
1712/1712 [==============================] - 1s 438us/step - loss: 7.9454e-04 - acc: 0.8294 - val_loss: 0.0011 - val_acc: 0.8061
Epoch 00044: val_loss improved from 0.00113 to 0.00111, saving model to my_model_RMSprop.h5
Epoch 45/80
1712/1712 [==============================] - 1s 449us/step - loss: 7.9163e-04 - acc: 0.8271 - val_loss: 0.0011 - val_acc: 0.7827
Epoch 00045: val_loss did not improve
Epoch 46/80
1712/1712 [==============================] - 1s 461us/step - loss: 7.8349e-04 - acc: 0.8289 - val_loss: 0.0011 - val_acc: 0.7850
Epoch 00046: val_loss did not improve
Epoch 47/80
1712/1712 [==============================] - 1s 452us/step - loss: 8.0320e-04 - acc: 0.8154 - val_loss: 0.0011 - val_acc: 0.7734
Epoch 00047: val_loss did not improve
Epoch 48/80
1712/1712 [==============================] - 1s 445us/step - loss: 7.7107e-04 - acc: 0.8154 - val_loss: 0.0011 - val_acc: 0.7780
Epoch 00048: val_loss did not improve
Epoch 49/80
1712/1712 [==============================] - 1s 459us/step - loss: 7.8850e-04 - acc: 0.8318 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00049: val_loss improved from 0.00111 to 0.00111, saving model to my_model_RMSprop.h5
Epoch 50/80
1712/1712 [==============================] - 1s 448us/step - loss: 7.9337e-04 - acc: 0.8283 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00050: val_loss did not improve
Epoch 51/80
1712/1712 [==============================] - ETA: 0s - loss: 7.8257e-04 - acc: 0.820 - 1s 443us/step - loss: 7.7825e-04 - acc: 0.8213 - val_loss: 0.0012 - val_acc: 0.8131
Epoch 00051: val_loss did not improve
Epoch 52/80
1712/1712 [==============================] - 1s 447us/step - loss: 7.6615e-04 - acc: 0.8201 - val_loss: 0.0013 - val_acc: 0.7710
Epoch 00052: val_loss did not improve
Epoch 53/80
1712/1712 [==============================] - 1s 447us/step - loss: 7.4822e-04 - acc: 0.8131 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00053: val_loss did not improve
Epoch 54/80
1712/1712 [==============================] - 1s 455us/step - loss: 7.4716e-04 - acc: 0.8265 - val_loss: 0.0011 - val_acc: 0.7687
Epoch 00054: val_loss did not improve
Epoch 55/80
1712/1712 [==============================] - 1s 443us/step - loss: 7.2166e-04 - acc: 0.8440 - val_loss: 0.0011 - val_acc: 0.7780
Epoch 00055: val_loss improved from 0.00111 to 0.00111, saving model to my_model_RMSprop.h5
Epoch 56/80
1712/1712 [==============================] - 1s 451us/step - loss: 7.3858e-04 - acc: 0.8388 - val_loss: 0.0011 - val_acc: 0.7617
Epoch 00056: val_loss did not improve
Epoch 57/80
1712/1712 [==============================] - 1s 451us/step - loss: 7.0425e-04 - acc: 0.8318 - val_loss: 0.0012 - val_acc: 0.7734
Epoch 00057: val_loss did not improve
Epoch 58/80
1712/1712 [==============================] - 1s 452us/step - loss: 7.3822e-04 - acc: 0.8411 - val_loss: 0.0011 - val_acc: 0.7827
Epoch 00058: val_loss improved from 0.00111 to 0.00109, saving model to my_model_RMSprop.h5
Epoch 59/80
1712/1712 [==============================] - 1s 443us/step - loss: 7.1866e-04 - acc: 0.8364 - val_loss: 0.0012 - val_acc: 0.7850
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 441us/step - loss: 7.1380e-04 - acc: 0.8341 - val_loss: 0.0011 - val_acc: 0.7827
Epoch 00060: val_loss improved from 0.00109 to 0.00109, saving model to my_model_RMSprop.h5
Epoch 61/80
1712/1712 [==============================] - 1s 438us/step - loss: 6.9996e-04 - acc: 0.8440 - val_loss: 0.0012 - val_acc: 0.7921
Epoch 00061: val_loss did not improve
Epoch 62/80
1712/1712 [==============================] - 1s 432us/step - loss: 7.1379e-04 - acc: 0.8370 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00062: val_loss did not improve
Epoch 63/80
1712/1712 [==============================] - 1s 434us/step - loss: 7.3945e-04 - acc: 0.8423 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00063: val_loss did not improve
Epoch 64/80
1712/1712 [==============================] - 1s 448us/step - loss: 6.9853e-04 - acc: 0.8481 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00064: val_loss did not improve
Epoch 65/80
1712/1712 [==============================] - 1s 448us/step - loss: 7.1748e-04 - acc: 0.8493 - val_loss: 0.0011 - val_acc: 0.7804
Epoch 00065: val_loss did not improve
Epoch 66/80
1712/1712 [==============================] - 1s 441us/step - loss: 7.1832e-04 - acc: 0.8458 - val_loss: 0.0012 - val_acc: 0.7804
Epoch 00066: val_loss did not improve
Epoch 67/80
1712/1712 [==============================] - 1s 449us/step - loss: 6.8407e-04 - acc: 0.8516 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00067: val_loss did not improve
Epoch 68/80
1712/1712 [==============================] - 1s 442us/step - loss: 6.6932e-04 - acc: 0.8575 - val_loss: 0.0012 - val_acc: 0.7874
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 459us/step - loss: 6.9349e-04 - acc: 0.8481 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00069: val_loss did not improve
Epoch 70/80
1712/1712 [==============================] - 1s 446us/step - loss: 6.9624e-04 - acc: 0.8534 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00070: val_loss did not improve
Epoch 71/80
1712/1712 [==============================] - 1s 441us/step - loss: 6.5384e-04 - acc: 0.8487 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00071: val_loss did not improve
Epoch 72/80
1712/1712 [==============================] - 1s 452us/step - loss: 6.8570e-04 - acc: 0.8627 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00072: val_loss did not improve
Epoch 73/80
1712/1712 [==============================] - 1s 451us/step - loss: 6.9590e-04 - acc: 0.8458 - val_loss: 0.0011 - val_acc: 0.8178
Epoch 00073: val_loss improved from 0.00109 to 0.00109, saving model to my_model_RMSprop.h5
Epoch 74/80
1712/1712 [==============================] - 1s 437us/step - loss: 6.7575e-04 - acc: 0.8569 - val_loss: 0.0012 - val_acc: 0.7804
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 448us/step - loss: 6.5800e-04 - acc: 0.8569 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00075: val_loss did not improve
Epoch 76/80
1712/1712 [==============================] - 1s 444us/step - loss: 7.0128e-04 - acc: 0.8458 - val_loss: 0.0011 - val_acc: 0.7827
Epoch 00076: val_loss did not improve
Epoch 77/80
1712/1712 [==============================] - 1s 453us/step - loss: 7.0785e-04 - acc: 0.8487 - val_loss: 0.0012 - val_acc: 0.8014
Epoch 00077: val_loss did not improve
Epoch 78/80
1712/1712 [==============================] - 1s 441us/step - loss: 6.7042e-04 - acc: 0.8411 - val_loss: 0.0011 - val_acc: 0.8107
Epoch 00078: val_loss did not improve
Epoch 79/80
1712/1712 [==============================] - 1s 440us/step - loss: 6.6017e-04 - acc: 0.8435 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00079: val_loss improved from 0.00109 to 0.00108, saving model to my_model_RMSprop.h5
Epoch 80/80
1712/1712 [==============================] - 1s 460us/step - loss: 6.7387e-04 - acc: 0.8569 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00080: val_loss did not improve
------------------->Evaluating Adagrad <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.1677 - acc: 0.3481 - val_loss: 0.0065 - val_acc: 0.6963
Epoch 00001: val_loss improved from inf to 0.00650, saving model to my_model_Adagrad.h5
Epoch 2/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0121 - acc: 0.5421 - val_loss: 0.0044 - val_acc: 0.6963
Epoch 00002: val_loss improved from 0.00650 to 0.00442, saving model to my_model_Adagrad.h5
Epoch 3/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0098 - acc: 0.5754 - val_loss: 0.0040 - val_acc: 0.6916
Epoch 00003: val_loss improved from 0.00442 to 0.00403, saving model to my_model_Adagrad.h5
Epoch 4/80
1712/1712 [==============================] - 1s 424us/step - loss: 0.0090 - acc: 0.5777 - val_loss: 0.0043 - val_acc: 0.6916
Epoch 00004: val_loss did not improve
Epoch 5/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0081 - acc: 0.6110 - val_loss: 0.0033 - val_acc: 0.6893
Epoch 00005: val_loss improved from 0.00403 to 0.00330, saving model to my_model_Adagrad.h5
Epoch 6/80
1712/1712 [==============================] - 1s 430us/step - loss: 0.0078 - acc: 0.6046 - val_loss: 0.0032 - val_acc: 0.6963
Epoch 00006: val_loss improved from 0.00330 to 0.00318, saving model to my_model_Adagrad.h5
Epoch 7/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0070 - acc: 0.6303 - val_loss: 0.0039 - val_acc: 0.6963
Epoch 00007: val_loss did not improve
Epoch 8/80
1712/1712 [==============================] - 1s 435us/step - loss: 0.0068 - acc: 0.6162 - val_loss: 0.0043 - val_acc: 0.7009
Epoch 00008: val_loss did not improve
Epoch 9/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0066 - acc: 0.6268 - val_loss: 0.0030 - val_acc: 0.6986
Epoch 00009: val_loss improved from 0.00318 to 0.00297, saving model to my_model_Adagrad.h5
Epoch 10/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0065 - acc: 0.6379 - val_loss: 0.0030 - val_acc: 0.7009
Epoch 00010: val_loss did not improve
Epoch 11/80
1712/1712 [==============================] - 1s 450us/step - loss: 0.0064 - acc: 0.6478 - val_loss: 0.0027 - val_acc: 0.6963
Epoch 00011: val_loss improved from 0.00297 to 0.00275, saving model to my_model_Adagrad.h5
Epoch 12/80
1712/1712 [==============================] - 1s 429us/step - loss: 0.0061 - acc: 0.6320 - val_loss: 0.0027 - val_acc: 0.6916
Epoch 00012: val_loss improved from 0.00275 to 0.00271, saving model to my_model_Adagrad.h5
Epoch 13/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0057 - acc: 0.6320 - val_loss: 0.0027 - val_acc: 0.6986
Epoch 00013: val_loss improved from 0.00271 to 0.00265, saving model to my_model_Adagrad.h5
Epoch 14/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0057 - acc: 0.6425 - val_loss: 0.0027 - val_acc: 0.7079
Epoch 00014: val_loss did not improve
Epoch 15/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0054 - acc: 0.6431 - val_loss: 0.0026 - val_acc: 0.7056
Epoch 00015: val_loss improved from 0.00265 to 0.00257, saving model to my_model_Adagrad.h5
Epoch 16/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0053 - acc: 0.6431 - val_loss: 0.0027 - val_acc: 0.6963
Epoch 00016: val_loss did not improve
Epoch 17/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0052 - acc: 0.6379 - val_loss: 0.0028 - val_acc: 0.7009
Epoch 00017: val_loss did not improve
Epoch 18/80
1712/1712 [==============================] - 1s 437us/step - loss: 0.0053 - acc: 0.6565 - val_loss: 0.0025 - val_acc: 0.6986
Epoch 00018: val_loss improved from 0.00257 to 0.00249, saving model to my_model_Adagrad.h5
Epoch 19/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0052 - acc: 0.6507 - val_loss: 0.0025 - val_acc: 0.7056
Epoch 00019: val_loss improved from 0.00249 to 0.00248, saving model to my_model_Adagrad.h5
Epoch 20/80
1712/1712 [==============================] - 1s 429us/step - loss: 0.0049 - acc: 0.6589 - val_loss: 0.0025 - val_acc: 0.7056
Epoch 00020: val_loss did not improve
Epoch 21/80
1712/1712 [==============================] - 1s 442us/step - loss: 0.0048 - acc: 0.6542 - val_loss: 0.0027 - val_acc: 0.7103
Epoch 00021: val_loss did not improve
Epoch 22/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0048 - acc: 0.6513 - val_loss: 0.0025 - val_acc: 0.7056
Epoch 00022: val_loss did not improve
Epoch 23/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0047 - acc: 0.6495 - val_loss: 0.0026 - val_acc: 0.7056
Epoch 00023: val_loss did not improve
Epoch 24/80
1712/1712 [==============================] - 1s 426us/step - loss: 0.0047 - acc: 0.6460 - val_loss: 0.0023 - val_acc: 0.7103
Epoch 00024: val_loss improved from 0.00248 to 0.00233, saving model to my_model_Adagrad.h5
Epoch 25/80
1712/1712 [==============================] - 1s 447us/step - loss: 0.0046 - acc: 0.6723 - val_loss: 0.0023 - val_acc: 0.7056
Epoch 00025: val_loss improved from 0.00233 to 0.00230, saving model to my_model_Adagrad.h5
Epoch 26/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0044 - acc: 0.6659 - val_loss: 0.0024 - val_acc: 0.7033
Epoch 00026: val_loss did not improve
Epoch 27/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0043 - acc: 0.6863 - val_loss: 0.0023 - val_acc: 0.7033
Epoch 00027: val_loss did not improve
Epoch 28/80
1712/1712 [==============================] - 1s 434us/step - loss: 0.0042 - acc: 0.6857 - val_loss: 0.0023 - val_acc: 0.7079
Epoch 00028: val_loss improved from 0.00230 to 0.00227, saving model to my_model_Adagrad.h5
Epoch 29/80
1712/1712 [==============================] - 1s 434us/step - loss: 0.0043 - acc: 0.6676 - val_loss: 0.0024 - val_acc: 0.7033
Epoch 00029: val_loss did not improve
Epoch 30/80
1712/1712 [==============================] - 1s 435us/step - loss: 0.0043 - acc: 0.6671 - val_loss: 0.0024 - val_acc: 0.7033
Epoch 00030: val_loss did not improve
Epoch 31/80
1712/1712 [==============================] - 1s 437us/step - loss: 0.0044 - acc: 0.6741 - val_loss: 0.0024 - val_acc: 0.7079
Epoch 00031: val_loss did not improve
Epoch 32/80
1712/1712 [==============================] - 1s 437us/step - loss: 0.0041 - acc: 0.6863 - val_loss: 0.0023 - val_acc: 0.7103
Epoch 00032: val_loss did not improve
Epoch 33/80
1712/1712 [==============================] - 1s 429us/step - loss: 0.0040 - acc: 0.6916 - val_loss: 0.0022 - val_acc: 0.7150
Epoch 00033: val_loss improved from 0.00227 to 0.00216, saving model to my_model_Adagrad.h5
Epoch 34/80
1712/1712 [==============================] - 1s 435us/step - loss: 0.0040 - acc: 0.6729 - val_loss: 0.0027 - val_acc: 0.7150
Epoch 00034: val_loss did not improve
Epoch 35/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0040 - acc: 0.6746 - val_loss: 0.0024 - val_acc: 0.7079
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 442us/step - loss: 0.0040 - acc: 0.6717 - val_loss: 0.0026 - val_acc: 0.7103
Epoch 00036: val_loss did not improve
Epoch 37/80
1712/1712 [==============================] - 1s 449us/step - loss: 0.0039 - acc: 0.6928 - val_loss: 0.0024 - val_acc: 0.7196
Epoch 00037: val_loss did not improve
Epoch 38/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0039 - acc: 0.6916 - val_loss: 0.0026 - val_acc: 0.7173
Epoch 00038: val_loss did not improve
Epoch 39/80
1712/1712 [==============================] - 1s 428us/step - loss: 0.0038 - acc: 0.6904 - val_loss: 0.0021 - val_acc: 0.7173
Epoch 00039: val_loss improved from 0.00216 to 0.00210, saving model to my_model_Adagrad.h5
Epoch 40/80
1712/1712 [==============================] - 1s 450us/step - loss: 0.0037 - acc: 0.6945 - val_loss: 0.0021 - val_acc: 0.7103
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0037 - acc: 0.6939 - val_loss: 0.0021 - val_acc: 0.7220
Epoch 00041: val_loss improved from 0.00210 to 0.00205, saving model to my_model_Adagrad.h5
Epoch 42/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0036 - acc: 0.6887 - val_loss: 0.0022 - val_acc: 0.7126
Epoch 00042: val_loss did not improve
Epoch 43/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0037 - acc: 0.6881 - val_loss: 0.0021 - val_acc: 0.7196
Epoch 00043: val_loss did not improve
Epoch 44/80
1712/1712 [==============================] - 1s 432us/step - loss: 0.0037 - acc: 0.6963 - val_loss: 0.0021 - val_acc: 0.7220
Epoch 00044: val_loss did not improve
Epoch 45/80
1712/1712 [==============================] - 1s 437us/step - loss: 0.0036 - acc: 0.7021 - val_loss: 0.0020 - val_acc: 0.7079
Epoch 00045: val_loss improved from 0.00205 to 0.00205, saving model to my_model_Adagrad.h5
Epoch 46/80
1712/1712 [==============================] - 1s 450us/step - loss: 0.0035 - acc: 0.6957 - val_loss: 0.0020 - val_acc: 0.7126
Epoch 00046: val_loss improved from 0.00205 to 0.00203, saving model to my_model_Adagrad.h5
Epoch 47/80
1712/1712 [==============================] - 1s 454us/step - loss: 0.0036 - acc: 0.6939 - val_loss: 0.0020 - val_acc: 0.7243
Epoch 00047: val_loss improved from 0.00203 to 0.00203, saving model to my_model_Adagrad.h5
Epoch 48/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0035 - acc: 0.6963 - val_loss: 0.0021 - val_acc: 0.7103
Epoch 00048: val_loss did not improve
Epoch 49/80
1712/1712 [==============================] - 1s 432us/step - loss: 0.0034 - acc: 0.6910 - val_loss: 0.0022 - val_acc: 0.7220
Epoch 00049: val_loss did not improve
Epoch 50/80
1712/1712 [==============================] - 1s 430us/step - loss: 0.0035 - acc: 0.6986 - val_loss: 0.0020 - val_acc: 0.7243
Epoch 00050: val_loss improved from 0.00203 to 0.00199, saving model to my_model_Adagrad.h5
Epoch 51/80
1712/1712 [==============================] - ETA: 0s - loss: 0.0034 - acc: 0.698 - 1s 442us/step - loss: 0.0034 - acc: 0.6963 - val_loss: 0.0020 - val_acc: 0.7196
Epoch 00051: val_loss did not improve
Epoch 52/80
1712/1712 [==============================] - 1s 434us/step - loss: 0.0033 - acc: 0.6957 - val_loss: 0.0020 - val_acc: 0.7103
Epoch 00052: val_loss improved from 0.00199 to 0.00196, saving model to my_model_Adagrad.h5
Epoch 53/80
1712/1712 [==============================] - 1s 429us/step - loss: 0.0033 - acc: 0.7004 - val_loss: 0.0020 - val_acc: 0.7079
Epoch 00053: val_loss did not improve
Epoch 54/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0033 - acc: 0.7062 - val_loss: 0.0020 - val_acc: 0.7103
Epoch 00054: val_loss did not improve
Epoch 55/80
1712/1712 [==============================] - 1s 430us/step - loss: 0.0033 - acc: 0.6980 - val_loss: 0.0023 - val_acc: 0.7126
Epoch 00055: val_loss did not improve
Epoch 56/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0032 - acc: 0.7050 - val_loss: 0.0020 - val_acc: 0.7173
Epoch 00056: val_loss did not improve
Epoch 57/80
1712/1712 [==============================] - 1s 435us/step - loss: 0.0033 - acc: 0.7021 - val_loss: 0.0019 - val_acc: 0.7150
Epoch 00057: val_loss improved from 0.00196 to 0.00194, saving model to my_model_Adagrad.h5
Epoch 58/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0032 - acc: 0.6992 - val_loss: 0.0021 - val_acc: 0.7103
Epoch 00058: val_loss did not improve
Epoch 59/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0032 - acc: 0.7062 - val_loss: 0.0023 - val_acc: 0.7103
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0031 - acc: 0.7027 - val_loss: 0.0019 - val_acc: 0.7150
Epoch 00060: val_loss improved from 0.00194 to 0.00191, saving model to my_model_Adagrad.h5
Epoch 61/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0031 - acc: 0.7079 - val_loss: 0.0020 - val_acc: 0.7150
Epoch 00061: val_loss did not improve
Epoch 62/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0031 - acc: 0.7150 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00062: val_loss did not improve
Epoch 63/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0032 - acc: 0.6968 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00063: val_loss improved from 0.00191 to 0.00190, saving model to my_model_Adagrad.h5
Epoch 64/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0031 - acc: 0.7132 - val_loss: 0.0020 - val_acc: 0.7220
Epoch 00064: val_loss did not improve
Epoch 65/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0031 - acc: 0.7068 - val_loss: 0.0019 - val_acc: 0.7220
Epoch 00065: val_loss did not improve
Epoch 66/80
1712/1712 [==============================] - 1s 449us/step - loss: 0.0031 - acc: 0.7138 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00066: val_loss improved from 0.00190 to 0.00187, saving model to my_model_Adagrad.h5
Epoch 67/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0030 - acc: 0.7144 - val_loss: 0.0020 - val_acc: 0.7266
Epoch 00067: val_loss did not improve
Epoch 68/80
1712/1712 [==============================] - 1s 449us/step - loss: 0.0029 - acc: 0.7033 - val_loss: 0.0020 - val_acc: 0.7196
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 453us/step - loss: 0.0030 - acc: 0.7120 - val_loss: 0.0020 - val_acc: 0.7173
Epoch 00069: val_loss did not improve
Epoch 70/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0030 - acc: 0.7097 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00070: val_loss did not improve
Epoch 71/80
1712/1712 [==============================] - 1s 431us/step - loss: 0.0030 - acc: 0.7114 - val_loss: 0.0019 - val_acc: 0.7220
Epoch 00071: val_loss did not improve
Epoch 72/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0030 - acc: 0.7167 - val_loss: 0.0018 - val_acc: 0.7220
Epoch 00072: val_loss improved from 0.00187 to 0.00183, saving model to my_model_Adagrad.h5
Epoch 73/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0031 - acc: 0.7056 - val_loss: 0.0020 - val_acc: 0.7196
Epoch 00073: val_loss did not improve
Epoch 74/80
1712/1712 [==============================] - 1s 430us/step - loss: 0.0028 - acc: 0.7126 - val_loss: 0.0020 - val_acc: 0.7266
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0029 - acc: 0.7155 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00075: val_loss did not improve
Epoch 76/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0029 - acc: 0.7243 - val_loss: 0.0018 - val_acc: 0.7243
Epoch 00076: val_loss did not improve
Epoch 77/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0028 - acc: 0.7266 - val_loss: 0.0019 - val_acc: 0.7243
Epoch 00077: val_loss did not improve
Epoch 78/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0029 - acc: 0.7208 - val_loss: 0.0018 - val_acc: 0.7220
Epoch 00078: val_loss improved from 0.00183 to 0.00183, saving model to my_model_Adagrad.h5
Epoch 79/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0029 - acc: 0.7126 - val_loss: 0.0019 - val_acc: 0.7266
Epoch 00079: val_loss did not improve
Epoch 80/80
1712/1712 [==============================] - 1s 436us/step - loss: 0.0028 - acc: 0.7249 - val_loss: 0.0018 - val_acc: 0.7266
Epoch 00080: val_loss improved from 0.00183 to 0.00180, saving model to my_model_Adagrad.h5
------------------->Evaluating Adadelta <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.0302 - acc: 0.3902 - val_loss: 0.0088 - val_acc: 0.6963
Epoch 00001: val_loss improved from inf to 0.00880, saving model to my_model_Adadelta.h5
Epoch 2/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0117 - acc: 0.5386 - val_loss: 0.0046 - val_acc: 0.6963
Epoch 00002: val_loss improved from 0.00880 to 0.00464, saving model to my_model_Adadelta.h5
Epoch 3/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0087 - acc: 0.5970 - val_loss: 0.0044 - val_acc: 0.6963
Epoch 00003: val_loss improved from 0.00464 to 0.00438, saving model to my_model_Adadelta.h5
Epoch 4/80
1712/1712 [==============================] - 1s 483us/step - loss: 0.0074 - acc: 0.6192 - val_loss: 0.0043 - val_acc: 0.6963
Epoch 00004: val_loss improved from 0.00438 to 0.00431, saving model to my_model_Adadelta.h5
Epoch 5/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0066 - acc: 0.6238 - val_loss: 0.0047 - val_acc: 0.6963
Epoch 00005: val_loss did not improve
Epoch 6/80
1712/1712 [==============================] - ETA: 0s - loss: 0.0062 - acc: 0.633 - 1s 472us/step - loss: 0.0061 - acc: 0.6314 - val_loss: 0.0042 - val_acc: 0.6963
Epoch 00006: val_loss improved from 0.00431 to 0.00415, saving model to my_model_Adadelta.h5
Epoch 7/80
1712/1712 [==============================] - 1s 456us/step - loss: 0.0057 - acc: 0.6711 - val_loss: 0.0041 - val_acc: 0.6963
Epoch 00007: val_loss improved from 0.00415 to 0.00406, saving model to my_model_Adadelta.h5
Epoch 8/80
1712/1712 [==============================] - 1s 465us/step - loss: 0.0054 - acc: 0.6671 - val_loss: 0.0045 - val_acc: 0.6963
Epoch 00008: val_loss did not improve
Epoch 9/80
1712/1712 [==============================] - 1s 472us/step - loss: 0.0052 - acc: 0.6805 - val_loss: 0.0038 - val_acc: 0.6963
Epoch 00009: val_loss improved from 0.00406 to 0.00384, saving model to my_model_Adadelta.h5
Epoch 10/80
1712/1712 [==============================] - 1s 483us/step - loss: 0.0049 - acc: 0.6881 - val_loss: 0.0043 - val_acc: 0.6963
Epoch 00010: val_loss did not improve
Epoch 11/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0047 - acc: 0.6893 - val_loss: 0.0040 - val_acc: 0.7033
Epoch 00011: val_loss did not improve
Epoch 12/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0044 - acc: 0.7021 - val_loss: 0.0039 - val_acc: 0.7033
Epoch 00012: val_loss did not improve
Epoch 13/80
1712/1712 [==============================] - 1s 489us/step - loss: 0.0044 - acc: 0.7004 - val_loss: 0.0037 - val_acc: 0.7009
Epoch 00013: val_loss improved from 0.00384 to 0.00369, saving model to my_model_Adadelta.h5
Epoch 14/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0041 - acc: 0.7033 - val_loss: 0.0039 - val_acc: 0.7009
Epoch 00014: val_loss did not improve
Epoch 15/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0039 - acc: 0.7068 - val_loss: 0.0047 - val_acc: 0.7056
Epoch 00015: val_loss did not improve
Epoch 16/80
1712/1712 [==============================] - 1s 464us/step - loss: 0.0038 - acc: 0.7132 - val_loss: 0.0033 - val_acc: 0.7079
Epoch 00016: val_loss improved from 0.00369 to 0.00329, saving model to my_model_Adadelta.h5
Epoch 17/80
1712/1712 [==============================] - 1s 489us/step - loss: 0.0036 - acc: 0.7342 - val_loss: 0.0036 - val_acc: 0.7033
Epoch 00017: val_loss did not improve
Epoch 18/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0035 - acc: 0.7126 - val_loss: 0.0031 - val_acc: 0.7220
Epoch 00018: val_loss improved from 0.00329 to 0.00311, saving model to my_model_Adadelta.h5
Epoch 19/80
1712/1712 [==============================] - 1s 468us/step - loss: 0.0034 - acc: 0.7196 - val_loss: 0.0033 - val_acc: 0.7220
Epoch 00019: val_loss did not improve
Epoch 20/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0032 - acc: 0.7342 - val_loss: 0.0029 - val_acc: 0.7243
Epoch 00020: val_loss improved from 0.00311 to 0.00290, saving model to my_model_Adadelta.h5
Epoch 21/80
1712/1712 [==============================] - 1s 482us/step - loss: 0.0030 - acc: 0.7208 - val_loss: 0.0029 - val_acc: 0.7290
Epoch 00021: val_loss did not improve
Epoch 22/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0029 - acc: 0.7313 - val_loss: 0.0029 - val_acc: 0.7220
Epoch 00022: val_loss improved from 0.00290 to 0.00289, saving model to my_model_Adadelta.h5
Epoch 23/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0028 - acc: 0.7342 - val_loss: 0.0027 - val_acc: 0.7290
Epoch 00023: val_loss improved from 0.00289 to 0.00269, saving model to my_model_Adadelta.h5
Epoch 24/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0027 - acc: 0.7342 - val_loss: 0.0025 - val_acc: 0.7266
Epoch 00024: val_loss improved from 0.00269 to 0.00246, saving model to my_model_Adadelta.h5
Epoch 25/80
1712/1712 [==============================] - 1s 484us/step - loss: 0.0026 - acc: 0.7319 - val_loss: 0.0023 - val_acc: 0.7360
Epoch 00025: val_loss improved from 0.00246 to 0.00229, saving model to my_model_Adadelta.h5
Epoch 26/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0025 - acc: 0.7336 - val_loss: 0.0023 - val_acc: 0.7407
Epoch 00026: val_loss improved from 0.00229 to 0.00226, saving model to my_model_Adadelta.h5
Epoch 27/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0024 - acc: 0.7430 - val_loss: 0.0022 - val_acc: 0.7383
Epoch 00027: val_loss improved from 0.00226 to 0.00221, saving model to my_model_Adadelta.h5
Epoch 28/80
1712/1712 [==============================] - 1s 479us/step - loss: 0.0023 - acc: 0.7453 - val_loss: 0.0022 - val_acc: 0.7336
Epoch 00028: val_loss improved from 0.00221 to 0.00217, saving model to my_model_Adadelta.h5
Epoch 29/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0023 - acc: 0.7342 - val_loss: 0.0022 - val_acc: 0.7290
Epoch 00029: val_loss did not improve
Epoch 30/80
1712/1712 [==============================] - 1s 478us/step - loss: 0.0022 - acc: 0.7407 - val_loss: 0.0020 - val_acc: 0.7336
Epoch 00030: val_loss improved from 0.00217 to 0.00205, saving model to my_model_Adadelta.h5
Epoch 31/80
1712/1712 [==============================] - 1s 480us/step - loss: 0.0022 - acc: 0.7477 - val_loss: 0.0020 - val_acc: 0.7243
Epoch 00031: val_loss improved from 0.00205 to 0.00199, saving model to my_model_Adadelta.h5
Epoch 32/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0021 - acc: 0.7482 - val_loss: 0.0020 - val_acc: 0.7360
Epoch 00032: val_loss did not improve
Epoch 33/80
1712/1712 [==============================] - 1s 463us/step - loss: 0.0021 - acc: 0.7442 - val_loss: 0.0019 - val_acc: 0.7477
Epoch 00033: val_loss improved from 0.00199 to 0.00194, saving model to my_model_Adadelta.h5
Epoch 34/80
1712/1712 [==============================] - 1s 472us/step - loss: 0.0020 - acc: 0.7471 - val_loss: 0.0019 - val_acc: 0.7336
Epoch 00034: val_loss improved from 0.00194 to 0.00189, saving model to my_model_Adadelta.h5
Epoch 35/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0020 - acc: 0.7319 - val_loss: 0.0019 - val_acc: 0.7430
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0020 - acc: 0.7512 - val_loss: 0.0019 - val_acc: 0.7383
Epoch 00036: val_loss improved from 0.00189 to 0.00185, saving model to my_model_Adadelta.h5
Epoch 37/80
1712/1712 [==============================] - 1s 468us/step - loss: 0.0019 - acc: 0.7477 - val_loss: 0.0022 - val_acc: 0.7453
Epoch 00037: val_loss did not improve
Epoch 38/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0019 - acc: 0.7582 - val_loss: 0.0018 - val_acc: 0.7383
Epoch 00038: val_loss improved from 0.00185 to 0.00178, saving model to my_model_Adadelta.h5
Epoch 39/80
1712/1712 [==============================] - 1s 468us/step - loss: 0.0019 - acc: 0.7523 - val_loss: 0.0019 - val_acc: 0.7430
Epoch 00039: val_loss did not improve
Epoch 40/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0018 - acc: 0.7482 - val_loss: 0.0019 - val_acc: 0.7500
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0018 - acc: 0.7588 - val_loss: 0.0017 - val_acc: 0.7313
Epoch 00041: val_loss improved from 0.00178 to 0.00174, saving model to my_model_Adadelta.h5
Epoch 42/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0018 - acc: 0.7477 - val_loss: 0.0017 - val_acc: 0.7407
Epoch 00042: val_loss improved from 0.00174 to 0.00172, saving model to my_model_Adadelta.h5
Epoch 43/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0017 - acc: 0.7582 - val_loss: 0.0017 - val_acc: 0.7407
Epoch 00043: val_loss improved from 0.00172 to 0.00172, saving model to my_model_Adadelta.h5
Epoch 44/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0017 - acc: 0.7558 - val_loss: 0.0017 - val_acc: 0.7430
Epoch 00044: val_loss improved from 0.00172 to 0.00168, saving model to my_model_Adadelta.h5
Epoch 45/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0017 - acc: 0.7523 - val_loss: 0.0019 - val_acc: 0.7477
Epoch 00045: val_loss did not improve
Epoch 46/80
1712/1712 [==============================] - 1s 467us/step - loss: 0.0017 - acc: 0.7588 - val_loss: 0.0016 - val_acc: 0.7430
Epoch 00046: val_loss improved from 0.00168 to 0.00164, saving model to my_model_Adadelta.h5
Epoch 47/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0017 - acc: 0.7599 - val_loss: 0.0018 - val_acc: 0.7407
Epoch 00047: val_loss did not improve
Epoch 48/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0016 - acc: 0.7518 - val_loss: 0.0016 - val_acc: 0.7430
Epoch 00048: val_loss did not improve
Epoch 49/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0016 - acc: 0.7634 - val_loss: 0.0016 - val_acc: 0.7453
Epoch 00049: val_loss improved from 0.00164 to 0.00161, saving model to my_model_Adadelta.h5
Epoch 50/80
1712/1712 [==============================] - 1s 467us/step - loss: 0.0016 - acc: 0.7646 - val_loss: 0.0017 - val_acc: 0.7360
Epoch 00050: val_loss did not improve
Epoch 51/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0016 - acc: 0.7582 - val_loss: 0.0016 - val_acc: 0.7453
Epoch 00051: val_loss improved from 0.00161 to 0.00160, saving model to my_model_Adadelta.h5
Epoch 52/80
1712/1712 [==============================] - 1s 484us/step - loss: 0.0015 - acc: 0.7745 - val_loss: 0.0017 - val_acc: 0.7547
Epoch 00052: val_loss did not improve
Epoch 53/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0015 - acc: 0.7681 - val_loss: 0.0015 - val_acc: 0.7453
Epoch 00053: val_loss improved from 0.00160 to 0.00155, saving model to my_model_Adadelta.h5
Epoch 54/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0015 - acc: 0.7652 - val_loss: 0.0016 - val_acc: 0.7593
Epoch 00054: val_loss did not improve
Epoch 55/80
1712/1712 [==============================] - 1s 483us/step - loss: 0.0015 - acc: 0.7558 - val_loss: 0.0018 - val_acc: 0.7430
Epoch 00055: val_loss did not improve
Epoch 56/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0015 - acc: 0.7734 - val_loss: 0.0015 - val_acc: 0.7477
Epoch 00056: val_loss improved from 0.00155 to 0.00151, saving model to my_model_Adadelta.h5
Epoch 57/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0014 - acc: 0.7739 - val_loss: 0.0015 - val_acc: 0.7336
Epoch 00057: val_loss did not improve
Epoch 58/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0014 - acc: 0.7634 - val_loss: 0.0015 - val_acc: 0.7500
Epoch 00058: val_loss improved from 0.00151 to 0.00149, saving model to my_model_Adadelta.h5
Epoch 59/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0014 - acc: 0.7739 - val_loss: 0.0015 - val_acc: 0.7430
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0014 - acc: 0.7745 - val_loss: 0.0015 - val_acc: 0.7523
Epoch 00060: val_loss improved from 0.00149 to 0.00147, saving model to my_model_Adadelta.h5
Epoch 61/80
1712/1712 [==============================] - 1s 479us/step - loss: 0.0014 - acc: 0.7728 - val_loss: 0.0015 - val_acc: 0.7547
Epoch 00061: val_loss improved from 0.00147 to 0.00146, saving model to my_model_Adadelta.h5
Epoch 62/80
1712/1712 [==============================] - 1s 480us/step - loss: 0.0014 - acc: 0.7710 - val_loss: 0.0015 - val_acc: 0.7734
Epoch 00062: val_loss improved from 0.00146 to 0.00146, saving model to my_model_Adadelta.h5
Epoch 63/80
1712/1712 [==============================] - 1s 468us/step - loss: 0.0014 - acc: 0.7757 - val_loss: 0.0015 - val_acc: 0.7523
Epoch 00063: val_loss did not improve
Epoch 64/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0013 - acc: 0.7886 - val_loss: 0.0015 - val_acc: 0.7593
Epoch 00064: val_loss improved from 0.00146 to 0.00146, saving model to my_model_Adadelta.h5
Epoch 65/80
1712/1712 [==============================] - 1s 458us/step - loss: 0.0013 - acc: 0.7775 - val_loss: 0.0014 - val_acc: 0.7780
Epoch 00065: val_loss improved from 0.00146 to 0.00142, saving model to my_model_Adadelta.h5
Epoch 66/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0013 - acc: 0.7780 - val_loss: 0.0014 - val_acc: 0.7687
Epoch 00066: val_loss improved from 0.00142 to 0.00142, saving model to my_model_Adadelta.h5
Epoch 67/80
1712/1712 [==============================] - 1s 480us/step - loss: 0.0013 - acc: 0.7815 - val_loss: 0.0014 - val_acc: 0.7757
Epoch 00067: val_loss improved from 0.00142 to 0.00139, saving model to my_model_Adadelta.h5
Epoch 68/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0013 - acc: 0.7757 - val_loss: 0.0014 - val_acc: 0.7757
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0013 - acc: 0.7810 - val_loss: 0.0014 - val_acc: 0.7734
Epoch 00069: val_loss improved from 0.00139 to 0.00138, saving model to my_model_Adadelta.h5
Epoch 70/80
1712/1712 [==============================] - 1s 472us/step - loss: 0.0013 - acc: 0.7886 - val_loss: 0.0014 - val_acc: 0.7734
Epoch 00070: val_loss did not improve
Epoch 71/80
1712/1712 [==============================] - 1s 480us/step - loss: 0.0013 - acc: 0.7868 - val_loss: 0.0014 - val_acc: 0.7710
Epoch 00071: val_loss did not improve
Epoch 72/80
1712/1712 [==============================] - 1s 478us/step - loss: 0.0013 - acc: 0.7827 - val_loss: 0.0014 - val_acc: 0.7804
Epoch 00072: val_loss did not improve
Epoch 73/80
1712/1712 [==============================] - 1s 468us/step - loss: 0.0012 - acc: 0.7880 - val_loss: 0.0014 - val_acc: 0.7687
Epoch 00073: val_loss did not improve
Epoch 74/80
1712/1712 [==============================] - 1s 472us/step - loss: 0.0013 - acc: 0.7973 - val_loss: 0.0014 - val_acc: 0.7874
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0013 - acc: 0.7944 - val_loss: 0.0014 - val_acc: 0.7921
Epoch 00075: val_loss improved from 0.00138 to 0.00135, saving model to my_model_Adadelta.h5
Epoch 76/80
1712/1712 [==============================] - 1s 467us/step - loss: 0.0012 - acc: 0.7991 - val_loss: 0.0014 - val_acc: 0.7640
Epoch 00076: val_loss did not improve
Epoch 77/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0012 - acc: 0.7909 - val_loss: 0.0013 - val_acc: 0.7734
Epoch 00077: val_loss improved from 0.00135 to 0.00133, saving model to my_model_Adadelta.h5
Epoch 78/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0012 - acc: 0.7944 - val_loss: 0.0013 - val_acc: 0.7897
Epoch 00078: val_loss did not improve
Epoch 79/80
1712/1712 [==============================] - 1s 472us/step - loss: 0.0012 - acc: 0.7856 - val_loss: 0.0014 - val_acc: 0.8014
Epoch 00079: val_loss did not improve
Epoch 80/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0012 - acc: 0.7903 - val_loss: 0.0013 - val_acc: 0.7804
Epoch 00080: val_loss improved from 0.00133 to 0.00133, saving model to my_model_Adadelta.h5
------------------->Evaluating Adam <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.0196 - acc: 0.4393 - val_loss: 0.0048 - val_acc: 0.6963
Epoch 00001: val_loss improved from inf to 0.00484, saving model to my_model_Adam.h5
Epoch 2/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0080 - acc: 0.6022 - val_loss: 0.0038 - val_acc: 0.6939
Epoch 00002: val_loss improved from 0.00484 to 0.00381, saving model to my_model_Adam.h5
Epoch 3/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0063 - acc: 0.6192 - val_loss: 0.0037 - val_acc: 0.7009
Epoch 00003: val_loss improved from 0.00381 to 0.00367, saving model to my_model_Adam.h5
Epoch 4/80
1712/1712 [==============================] - 1s 461us/step - loss: 0.0054 - acc: 0.6268 - val_loss: 0.0033 - val_acc: 0.7056
Epoch 00004: val_loss improved from 0.00367 to 0.00329, saving model to my_model_Adam.h5
Epoch 5/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0046 - acc: 0.6554 - val_loss: 0.0030 - val_acc: 0.7056
Epoch 00005: val_loss improved from 0.00329 to 0.00295, saving model to my_model_Adam.h5
Epoch 6/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0043 - acc: 0.6665 - val_loss: 0.0029 - val_acc: 0.6986
Epoch 00006: val_loss improved from 0.00295 to 0.00287, saving model to my_model_Adam.h5
Epoch 7/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0040 - acc: 0.6711 - val_loss: 0.0027 - val_acc: 0.7126
Epoch 00007: val_loss improved from 0.00287 to 0.00266, saving model to my_model_Adam.h5
Epoch 8/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0037 - acc: 0.6881 - val_loss: 0.0024 - val_acc: 0.7336
Epoch 00008: val_loss improved from 0.00266 to 0.00241, saving model to my_model_Adam.h5
Epoch 9/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0034 - acc: 0.6723 - val_loss: 0.0023 - val_acc: 0.7266
Epoch 00009: val_loss improved from 0.00241 to 0.00228, saving model to my_model_Adam.h5
Epoch 10/80
1712/1712 [==============================] - 1s 454us/step - loss: 0.0030 - acc: 0.6992 - val_loss: 0.0022 - val_acc: 0.7103
Epoch 00010: val_loss improved from 0.00228 to 0.00224, saving model to my_model_Adam.h5
Epoch 11/80
1712/1712 [==============================] - 1s 464us/step - loss: 0.0030 - acc: 0.7167 - val_loss: 0.0019 - val_acc: 0.7150
Epoch 00011: val_loss improved from 0.00224 to 0.00191, saving model to my_model_Adam.h5
Epoch 12/80
1712/1712 [==============================] - 1s 461us/step - loss: 0.0028 - acc: 0.7068 - val_loss: 0.0020 - val_acc: 0.7477
Epoch 00012: val_loss did not improve
Epoch 13/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0027 - acc: 0.7150 - val_loss: 0.0018 - val_acc: 0.7243
Epoch 00013: val_loss improved from 0.00191 to 0.00182, saving model to my_model_Adam.h5
Epoch 14/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0025 - acc: 0.7179 - val_loss: 0.0020 - val_acc: 0.7126
Epoch 00014: val_loss did not improve
Epoch 15/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0024 - acc: 0.7208 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00015: val_loss did not improve
Epoch 16/80
1712/1712 [==============================] - 1s 464us/step - loss: 0.0023 - acc: 0.7342 - val_loss: 0.0019 - val_acc: 0.7290
Epoch 00016: val_loss did not improve
Epoch 17/80
1712/1712 [==============================] - 1s 454us/step - loss: 0.0022 - acc: 0.7331 - val_loss: 0.0016 - val_acc: 0.7430
Epoch 00017: val_loss improved from 0.00182 to 0.00158, saving model to my_model_Adam.h5
Epoch 18/80
1712/1712 [==============================] - 1s 467us/step - loss: 0.0021 - acc: 0.7371 - val_loss: 0.0018 - val_acc: 0.7313
Epoch 00018: val_loss did not improve
Epoch 19/80
1712/1712 [==============================] - 1s 463us/step - loss: 0.0020 - acc: 0.7407 - val_loss: 0.0016 - val_acc: 0.7477
Epoch 00019: val_loss improved from 0.00158 to 0.00157, saving model to my_model_Adam.h5
Epoch 20/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0020 - acc: 0.7296 - val_loss: 0.0016 - val_acc: 0.7430
Epoch 00020: val_loss did not improve
Epoch 21/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0019 - acc: 0.7371 - val_loss: 0.0015 - val_acc: 0.7500
Epoch 00021: val_loss improved from 0.00157 to 0.00151, saving model to my_model_Adam.h5
Epoch 22/80
1712/1712 [==============================] - 1s 458us/step - loss: 0.0018 - acc: 0.7447 - val_loss: 0.0014 - val_acc: 0.7477
Epoch 00022: val_loss improved from 0.00151 to 0.00144, saving model to my_model_Adam.h5
Epoch 23/80
1712/1712 [==============================] - 1s 465us/step - loss: 0.0017 - acc: 0.7564 - val_loss: 0.0015 - val_acc: 0.7430
Epoch 00023: val_loss did not improve
Epoch 24/80
1712/1712 [==============================] - 1s 462us/step - loss: 0.0016 - acc: 0.7523 - val_loss: 0.0014 - val_acc: 0.7477
Epoch 00024: val_loss did not improve
Epoch 25/80
1712/1712 [==============================] - 1s 465us/step - loss: 0.0016 - acc: 0.7611 - val_loss: 0.0014 - val_acc: 0.7360
Epoch 00025: val_loss improved from 0.00144 to 0.00141, saving model to my_model_Adam.h5
Epoch 26/80
1712/1712 [==============================] - 1s 462us/step - loss: 0.0016 - acc: 0.7658 - val_loss: 0.0013 - val_acc: 0.7430
Epoch 00026: val_loss improved from 0.00141 to 0.00135, saving model to my_model_Adam.h5
Epoch 27/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0016 - acc: 0.7494 - val_loss: 0.0014 - val_acc: 0.7477
Epoch 00027: val_loss did not improve
Epoch 28/80
1712/1712 [==============================] - 1s 453us/step - loss: 0.0015 - acc: 0.7634 - val_loss: 0.0013 - val_acc: 0.7266
Epoch 00028: val_loss improved from 0.00135 to 0.00135, saving model to my_model_Adam.h5
Epoch 29/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0015 - acc: 0.7681 - val_loss: 0.0013 - val_acc: 0.7570
Epoch 00029: val_loss improved from 0.00135 to 0.00134, saving model to my_model_Adam.h5
Epoch 30/80
1712/1712 [==============================] - 1s 457us/step - loss: 0.0014 - acc: 0.7716 - val_loss: 0.0013 - val_acc: 0.7593
Epoch 00030: val_loss improved from 0.00134 to 0.00127, saving model to my_model_Adam.h5
Epoch 31/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0014 - acc: 0.7669 - val_loss: 0.0012 - val_acc: 0.7687
Epoch 00031: val_loss improved from 0.00127 to 0.00125, saving model to my_model_Adam.h5
Epoch 32/80
1712/1712 [==============================] - 1s 459us/step - loss: 0.0013 - acc: 0.7769 - val_loss: 0.0013 - val_acc: 0.7570
Epoch 00032: val_loss did not improve
Epoch 33/80
1712/1712 [==============================] - 1s 467us/step - loss: 0.0013 - acc: 0.7739 - val_loss: 0.0012 - val_acc: 0.7687
Epoch 00033: val_loss improved from 0.00125 to 0.00124, saving model to my_model_Adam.h5
Epoch 34/80
1712/1712 [==============================] - ETA: 0s - loss: 0.0013 - acc: 0.772 - 1s 477us/step - loss: 0.0013 - acc: 0.7739 - val_loss: 0.0013 - val_acc: 0.7500
Epoch 00034: val_loss did not improve
Epoch 35/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0012 - acc: 0.7821 - val_loss: 0.0012 - val_acc: 0.7593
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 470us/step - loss: 0.0012 - acc: 0.7722 - val_loss: 0.0012 - val_acc: 0.7593
Epoch 00036: val_loss improved from 0.00124 to 0.00119, saving model to my_model_Adam.h5
Epoch 37/80
1712/1712 [==============================] - 1s 456us/step - loss: 0.0012 - acc: 0.7810 - val_loss: 0.0013 - val_acc: 0.7570
Epoch 00037: val_loss did not improve
Epoch 38/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0012 - acc: 0.7821 - val_loss: 0.0012 - val_acc: 0.7804
Epoch 00038: val_loss improved from 0.00119 to 0.00118, saving model to my_model_Adam.h5
Epoch 39/80
1712/1712 [==============================] - 1s 457us/step - loss: 0.0012 - acc: 0.7850 - val_loss: 0.0012 - val_acc: 0.7921
Epoch 00039: val_loss improved from 0.00118 to 0.00117, saving model to my_model_Adam.h5
Epoch 40/80
1712/1712 [==============================] - 1s 456us/step - loss: 0.0011 - acc: 0.7915 - val_loss: 0.0012 - val_acc: 0.7757
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0011 - acc: 0.7868 - val_loss: 0.0012 - val_acc: 0.7640
Epoch 00041: val_loss did not improve
Epoch 42/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0012 - acc: 0.8008 - val_loss: 0.0012 - val_acc: 0.7827
Epoch 00042: val_loss did not improve
Epoch 43/80
1712/1712 [==============================] - 1s 465us/step - loss: 0.0011 - acc: 0.7926 - val_loss: 0.0012 - val_acc: 0.7757
Epoch 00043: val_loss improved from 0.00117 to 0.00116, saving model to my_model_Adam.h5
Epoch 44/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0011 - acc: 0.8002 - val_loss: 0.0011 - val_acc: 0.7710
Epoch 00044: val_loss improved from 0.00116 to 0.00115, saving model to my_model_Adam.h5
Epoch 45/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0011 - acc: 0.7950 - val_loss: 0.0012 - val_acc: 0.7897
Epoch 00045: val_loss did not improve
Epoch 46/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0010 - acc: 0.8096 - val_loss: 0.0011 - val_acc: 0.7734
Epoch 00046: val_loss improved from 0.00115 to 0.00112, saving model to my_model_Adam.h5
Epoch 47/80
1712/1712 [==============================] - 1s 462us/step - loss: 0.0010 - acc: 0.7961 - val_loss: 0.0011 - val_acc: 0.7617
Epoch 00047: val_loss did not improve
Epoch 48/80
1712/1712 [==============================] - 1s 459us/step - loss: 9.9876e-04 - acc: 0.8072 - val_loss: 0.0011 - val_acc: 0.7734
Epoch 00048: val_loss did not improve
Epoch 49/80
1712/1712 [==============================] - 1s 467us/step - loss: 0.0010 - acc: 0.8143 - val_loss: 0.0011 - val_acc: 0.7757
Epoch 00049: val_loss did not improve
Epoch 50/80
1712/1712 [==============================] - 1s 462us/step - loss: 0.0010 - acc: 0.8055 - val_loss: 0.0011 - val_acc: 0.7687
Epoch 00050: val_loss improved from 0.00112 to 0.00112, saving model to my_model_Adam.h5
Epoch 51/80
1712/1712 [==============================] - 1s 476us/step - loss: 9.7939e-04 - acc: 0.7973 - val_loss: 0.0012 - val_acc: 0.7664
Epoch 00051: val_loss did not improve
Epoch 52/80
1712/1712 [==============================] - 1s 457us/step - loss: 9.6854e-04 - acc: 0.8067 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00052: val_loss improved from 0.00112 to 0.00111, saving model to my_model_Adam.h5
Epoch 53/80
1712/1712 [==============================] - 1s 468us/step - loss: 9.8585e-04 - acc: 0.8125 - val_loss: 0.0011 - val_acc: 0.7734
Epoch 00053: val_loss improved from 0.00111 to 0.00110, saving model to my_model_Adam.h5
Epoch 54/80
1712/1712 [==============================] - 1s 474us/step - loss: 9.6280e-04 - acc: 0.8119 - val_loss: 0.0011 - val_acc: 0.7757
Epoch 00054: val_loss did not improve
Epoch 55/80
1712/1712 [==============================] - 1s 455us/step - loss: 9.6437e-04 - acc: 0.8172 - val_loss: 0.0011 - val_acc: 0.7710
Epoch 00055: val_loss improved from 0.00110 to 0.00109, saving model to my_model_Adam.h5
Epoch 56/80
1712/1712 [==============================] - 1s 444us/step - loss: 9.5305e-04 - acc: 0.8043 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00056: val_loss did not improve
Epoch 57/80
1712/1712 [==============================] - 1s 471us/step - loss: 9.4725e-04 - acc: 0.8178 - val_loss: 0.0011 - val_acc: 0.7780
Epoch 00057: val_loss did not improve
Epoch 58/80
1712/1712 [==============================] - 1s 472us/step - loss: 9.2077e-04 - acc: 0.8178 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00058: val_loss did not improve
Epoch 59/80
1712/1712 [==============================] - 1s 459us/step - loss: 8.9752e-04 - acc: 0.8218 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 472us/step - loss: 9.0780e-04 - acc: 0.8067 - val_loss: 0.0011 - val_acc: 0.7804
Epoch 00060: val_loss did not improve
Epoch 61/80
1712/1712 [==============================] - 1s 455us/step - loss: 9.1124e-04 - acc: 0.8236 - val_loss: 0.0011 - val_acc: 0.7687
Epoch 00061: val_loss improved from 0.00109 to 0.00108, saving model to my_model_Adam.h5
Epoch 62/80
1712/1712 [==============================] - 1s 449us/step - loss: 9.0752e-04 - acc: 0.8189 - val_loss: 0.0011 - val_acc: 0.7734
Epoch 00062: val_loss did not improve
Epoch 63/80
1712/1712 [==============================] - 1s 463us/step - loss: 9.3439e-04 - acc: 0.8195 - val_loss: 0.0011 - val_acc: 0.7780
Epoch 00063: val_loss did not improve
Epoch 64/80
1712/1712 [==============================] - 1s 461us/step - loss: 9.0890e-04 - acc: 0.8224 - val_loss: 0.0011 - val_acc: 0.7827
Epoch 00064: val_loss did not improve
Epoch 65/80
1712/1712 [==============================] - 1s 470us/step - loss: 8.9048e-04 - acc: 0.8014 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00065: val_loss did not improve
Epoch 66/80
1712/1712 [==============================] - 1s 480us/step - loss: 8.9936e-04 - acc: 0.8113 - val_loss: 0.0011 - val_acc: 0.7850
Epoch 00066: val_loss did not improve
Epoch 67/80
1712/1712 [==============================] - 1s 472us/step - loss: 8.7626e-04 - acc: 0.8230 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00067: val_loss did not improve
Epoch 68/80
1712/1712 [==============================] - 1s 451us/step - loss: 8.4106e-04 - acc: 0.8271 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 460us/step - loss: 8.5899e-04 - acc: 0.8271 - val_loss: 0.0011 - val_acc: 0.7850
Epoch 00069: val_loss improved from 0.00108 to 0.00105, saving model to my_model_Adam.h5
Epoch 70/80
1712/1712 [==============================] - 1s 463us/step - loss: 8.6030e-04 - acc: 0.8137 - val_loss: 0.0011 - val_acc: 0.7850
Epoch 00070: val_loss did not improve
Epoch 71/80
1712/1712 [==============================] - 1s 465us/step - loss: 8.4626e-04 - acc: 0.8376 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00071: val_loss did not improve
Epoch 72/80
1712/1712 [==============================] - 1s 468us/step - loss: 8.3546e-04 - acc: 0.8347 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00072: val_loss did not improve
Epoch 73/80
1712/1712 [==============================] - 1s 465us/step - loss: 8.4262e-04 - acc: 0.8213 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00073: val_loss did not improve
Epoch 74/80
1712/1712 [==============================] - 1s 472us/step - loss: 8.6026e-04 - acc: 0.8119 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 456us/step - loss: 8.0431e-04 - acc: 0.8213 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00075: val_loss did not improve
Epoch 76/80
1712/1712 [==============================] - 1s 467us/step - loss: 8.7953e-04 - acc: 0.8224 - val_loss: 0.0010 - val_acc: 0.7897
Epoch 00076: val_loss improved from 0.00105 to 0.00104, saving model to my_model_Adam.h5
Epoch 77/80
1712/1712 [==============================] - 1s 476us/step - loss: 8.1410e-04 - acc: 0.8224 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00077: val_loss did not improve
Epoch 78/80
1712/1712 [==============================] - 1s 463us/step - loss: 8.1593e-04 - acc: 0.8359 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00078: val_loss did not improve
Epoch 79/80
1712/1712 [==============================] - 1s 456us/step - loss: 8.2789e-04 - acc: 0.8230 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00079: val_loss did not improve
Epoch 80/80
1712/1712 [==============================] - 1s 461us/step - loss: 8.2088e-04 - acc: 0.8283 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00080: val_loss did not improve
------------------->Evaluating Adamax <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.0227 - acc: 0.3902 - val_loss: 0.0045 - val_acc: 0.6963
Epoch 00001: val_loss improved from inf to 0.00445, saving model to my_model_Adamax.h5
Epoch 2/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0093 - acc: 0.5158 - val_loss: 0.0041 - val_acc: 0.6963
Epoch 00002: val_loss improved from 0.00445 to 0.00410, saving model to my_model_Adamax.h5
Epoch 3/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0078 - acc: 0.5707 - val_loss: 0.0040 - val_acc: 0.6986
Epoch 00003: val_loss improved from 0.00410 to 0.00404, saving model to my_model_Adamax.h5
Epoch 4/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0069 - acc: 0.5935 - val_loss: 0.0041 - val_acc: 0.7009
Epoch 00004: val_loss did not improve
Epoch 5/80
1712/1712 [==============================] - 1s 442us/step - loss: 0.0066 - acc: 0.5917 - val_loss: 0.0034 - val_acc: 0.7056
Epoch 00005: val_loss improved from 0.00404 to 0.00336, saving model to my_model_Adamax.h5
Epoch 6/80
1712/1712 [==============================] - 1s 438us/step - loss: 0.0061 - acc: 0.6238 - val_loss: 0.0033 - val_acc: 0.7033
Epoch 00006: val_loss improved from 0.00336 to 0.00331, saving model to my_model_Adamax.h5
Epoch 7/80
1712/1712 [==============================] - 1s 452us/step - loss: 0.0056 - acc: 0.6332 - val_loss: 0.0038 - val_acc: 0.7056
Epoch 00007: val_loss did not improve
Epoch 8/80
1712/1712 [==============================] - 1s 457us/step - loss: 0.0053 - acc: 0.6262 - val_loss: 0.0029 - val_acc: 0.6963
Epoch 00008: val_loss improved from 0.00331 to 0.00294, saving model to my_model_Adamax.h5
Epoch 9/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0049 - acc: 0.6197 - val_loss: 0.0027 - val_acc: 0.7056
Epoch 00009: val_loss improved from 0.00294 to 0.00273, saving model to my_model_Adamax.h5
Epoch 10/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0049 - acc: 0.6437 - val_loss: 0.0029 - val_acc: 0.6986
Epoch 00010: val_loss did not improve
Epoch 11/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0045 - acc: 0.6303 - val_loss: 0.0025 - val_acc: 0.7009
Epoch 00011: val_loss improved from 0.00273 to 0.00251, saving model to my_model_Adamax.h5
Epoch 12/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0044 - acc: 0.6536 - val_loss: 0.0024 - val_acc: 0.6939
Epoch 00012: val_loss improved from 0.00251 to 0.00243, saving model to my_model_Adamax.h5
Epoch 13/80
1712/1712 [==============================] - 1s 458us/step - loss: 0.0039 - acc: 0.6519 - val_loss: 0.0023 - val_acc: 0.6986
Epoch 00013: val_loss improved from 0.00243 to 0.00233, saving model to my_model_Adamax.h5
Epoch 14/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0040 - acc: 0.6577 - val_loss: 0.0023 - val_acc: 0.6986
Epoch 00014: val_loss improved from 0.00233 to 0.00227, saving model to my_model_Adamax.h5
Epoch 15/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0037 - acc: 0.6746 - val_loss: 0.0023 - val_acc: 0.6986
Epoch 00015: val_loss did not improve
Epoch 16/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0035 - acc: 0.6828 - val_loss: 0.0021 - val_acc: 0.7079
Epoch 00016: val_loss improved from 0.00227 to 0.00212, saving model to my_model_Adamax.h5
Epoch 17/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0034 - acc: 0.6986 - val_loss: 0.0021 - val_acc: 0.7103
Epoch 00017: val_loss improved from 0.00212 to 0.00205, saving model to my_model_Adamax.h5
Epoch 18/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0032 - acc: 0.7050 - val_loss: 0.0019 - val_acc: 0.7056
Epoch 00018: val_loss improved from 0.00205 to 0.00192, saving model to my_model_Adamax.h5
Epoch 19/80
1712/1712 [==============================] - 1s 449us/step - loss: 0.0031 - acc: 0.6968 - val_loss: 0.0019 - val_acc: 0.7196
Epoch 00019: val_loss improved from 0.00192 to 0.00186, saving model to my_model_Adamax.h5
Epoch 20/80
1712/1712 [==============================] - 1s 452us/step - loss: 0.0029 - acc: 0.6933 - val_loss: 0.0019 - val_acc: 0.7266
Epoch 00020: val_loss did not improve
Epoch 21/80
1712/1712 [==============================] - 1s 453us/step - loss: 0.0030 - acc: 0.7062 - val_loss: 0.0018 - val_acc: 0.7056
Epoch 00021: val_loss improved from 0.00186 to 0.00178, saving model to my_model_Adamax.h5
Epoch 22/80
1712/1712 [==============================] - 1s 453us/step - loss: 0.0027 - acc: 0.7091 - val_loss: 0.0017 - val_acc: 0.7313
Epoch 00022: val_loss improved from 0.00178 to 0.00172, saving model to my_model_Adamax.h5
Epoch 23/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0025 - acc: 0.7150 - val_loss: 0.0019 - val_acc: 0.7336
Epoch 00023: val_loss did not improve
Epoch 24/80
1712/1712 [==============================] - 1s 460us/step - loss: 0.0026 - acc: 0.7225 - val_loss: 0.0018 - val_acc: 0.7360
Epoch 00024: val_loss did not improve
Epoch 25/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0023 - acc: 0.7261 - val_loss: 0.0017 - val_acc: 0.7360
Epoch 00025: val_loss improved from 0.00172 to 0.00167, saving model to my_model_Adamax.h5
Epoch 26/80
1712/1712 [==============================] - 1s 437us/step - loss: 0.0023 - acc: 0.7395 - val_loss: 0.0017 - val_acc: 0.7383
Epoch 00026: val_loss did not improve
Epoch 27/80
1712/1712 [==============================] - 1s 450us/step - loss: 0.0022 - acc: 0.7261 - val_loss: 0.0015 - val_acc: 0.7430
Epoch 00027: val_loss improved from 0.00167 to 0.00152, saving model to my_model_Adamax.h5
Epoch 28/80
1712/1712 [==============================] - 1s 446us/step - loss: 0.0020 - acc: 0.7523 - val_loss: 0.0015 - val_acc: 0.7500
Epoch 00028: val_loss improved from 0.00152 to 0.00147, saving model to my_model_Adamax.h5
Epoch 29/80
1712/1712 [==============================] - 1s 443us/step - loss: 0.0020 - acc: 0.7395 - val_loss: 0.0016 - val_acc: 0.7453
Epoch 00029: val_loss did not improve
Epoch 30/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0020 - acc: 0.7494 - val_loss: 0.0015 - val_acc: 0.7570
Epoch 00030: val_loss did not improve
Epoch 31/80
1712/1712 [==============================] - 1s 442us/step - loss: 0.0019 - acc: 0.7471 - val_loss: 0.0014 - val_acc: 0.7570
Epoch 00031: val_loss improved from 0.00147 to 0.00143, saving model to my_model_Adamax.h5
Epoch 32/80
1712/1712 [==============================] - 1s 442us/step - loss: 0.0017 - acc: 0.7599 - val_loss: 0.0014 - val_acc: 0.7734
Epoch 00032: val_loss improved from 0.00143 to 0.00143, saving model to my_model_Adamax.h5
Epoch 33/80
1712/1712 [==============================] - 1s 452us/step - loss: 0.0018 - acc: 0.7623 - val_loss: 0.0014 - val_acc: 0.7523
Epoch 00033: val_loss improved from 0.00143 to 0.00142, saving model to my_model_Adamax.h5
Epoch 34/80
1712/1712 [==============================] - 1s 457us/step - loss: 0.0017 - acc: 0.7664 - val_loss: 0.0014 - val_acc: 0.7453
Epoch 00034: val_loss did not improve
Epoch 35/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0016 - acc: 0.7664 - val_loss: 0.0015 - val_acc: 0.7687
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 468us/step - loss: 0.0015 - acc: 0.7658 - val_loss: 0.0013 - val_acc: 0.7664
Epoch 00036: val_loss improved from 0.00142 to 0.00134, saving model to my_model_Adamax.h5
Epoch 37/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0015 - acc: 0.7646 - val_loss: 0.0014 - val_acc: 0.7570
Epoch 00037: val_loss did not improve
Epoch 38/80
1712/1712 [==============================] - 1s 456us/step - loss: 0.0014 - acc: 0.7693 - val_loss: 0.0014 - val_acc: 0.7734
Epoch 00038: val_loss did not improve
Epoch 39/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0014 - acc: 0.7699 - val_loss: 0.0012 - val_acc: 0.7757
Epoch 00039: val_loss improved from 0.00134 to 0.00124, saving model to my_model_Adamax.h5
Epoch 40/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0013 - acc: 0.7991 - val_loss: 0.0013 - val_acc: 0.7640
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 444us/step - loss: 0.0013 - acc: 0.7810 - val_loss: 0.0013 - val_acc: 0.7710
Epoch 00041: val_loss did not improve
Epoch 42/80
1712/1712 [==============================] - 1s 440us/step - loss: 0.0012 - acc: 0.7915 - val_loss: 0.0013 - val_acc: 0.7710
Epoch 00042: val_loss did not improve
Epoch 43/80
1712/1712 [==============================] - 1s 454us/step - loss: 0.0012 - acc: 0.7909 - val_loss: 0.0012 - val_acc: 0.7664
Epoch 00043: val_loss improved from 0.00124 to 0.00121, saving model to my_model_Adamax.h5
Epoch 44/80
1712/1712 [==============================] - 1s 455us/step - loss: 0.0012 - acc: 0.8043 - val_loss: 0.0012 - val_acc: 0.7944
Epoch 00044: val_loss did not improve
Epoch 45/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0012 - acc: 0.7991 - val_loss: 0.0012 - val_acc: 0.7991
Epoch 00045: val_loss improved from 0.00121 to 0.00115, saving model to my_model_Adamax.h5
Epoch 46/80
1712/1712 [==============================] - 1s 451us/step - loss: 0.0012 - acc: 0.7979 - val_loss: 0.0012 - val_acc: 0.7944
Epoch 00046: val_loss did not improve
Epoch 47/80
1712/1712 [==============================] - 1s 439us/step - loss: 0.0011 - acc: 0.7950 - val_loss: 0.0012 - val_acc: 0.7921
Epoch 00047: val_loss did not improve
Epoch 48/80
1712/1712 [==============================] - 1s 448us/step - loss: 0.0011 - acc: 0.8055 - val_loss: 0.0012 - val_acc: 0.7850
Epoch 00048: val_loss did not improve
Epoch 49/80
1712/1712 [==============================] - 1s 449us/step - loss: 0.0011 - acc: 0.7950 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00049: val_loss improved from 0.00115 to 0.00114, saving model to my_model_Adamax.h5
Epoch 50/80
1712/1712 [==============================] - 1s 445us/step - loss: 0.0011 - acc: 0.8090 - val_loss: 0.0012 - val_acc: 0.7921
Epoch 00050: val_loss did not improve
Epoch 51/80
1712/1712 [==============================] - 1s 441us/step - loss: 0.0011 - acc: 0.8055 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00051: val_loss improved from 0.00114 to 0.00113, saving model to my_model_Adamax.h5
Epoch 52/80
1712/1712 [==============================] - 1s 450us/step - loss: 0.0010 - acc: 0.8067 - val_loss: 0.0011 - val_acc: 0.7850
Epoch 00052: val_loss improved from 0.00113 to 0.00111, saving model to my_model_Adamax.h5
Epoch 53/80
1712/1712 [==============================] - 1s 441us/step - loss: 9.7671e-04 - acc: 0.8096 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00053: val_loss improved from 0.00111 to 0.00110, saving model to my_model_Adamax.h5
Epoch 54/80
1712/1712 [==============================] - 1s 452us/step - loss: 9.8551e-04 - acc: 0.8178 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00054: val_loss did not improve
Epoch 55/80
1712/1712 [==============================] - 1s 441us/step - loss: 9.5662e-04 - acc: 0.8131 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00055: val_loss improved from 0.00110 to 0.00108, saving model to my_model_Adamax.h5
Epoch 56/80
1712/1712 [==============================] - 1s 455us/step - loss: 9.3085e-04 - acc: 0.8201 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00056: val_loss did not improve
Epoch 57/80
1712/1712 [==============================] - 1s 451us/step - loss: 9.0877e-04 - acc: 0.8230 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00057: val_loss improved from 0.00108 to 0.00107, saving model to my_model_Adamax.h5
Epoch 58/80
1712/1712 [==============================] - 1s 455us/step - loss: 9.3023e-04 - acc: 0.8154 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00058: val_loss did not improve
Epoch 59/80
1712/1712 [==============================] - 1s 460us/step - loss: 9.1146e-04 - acc: 0.8107 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 445us/step - loss: 8.9275e-04 - acc: 0.8318 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00060: val_loss did not improve
Epoch 61/80
1712/1712 [==============================] - 1s 468us/step - loss: 8.2916e-04 - acc: 0.8224 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00061: val_loss did not improve
Epoch 62/80
1712/1712 [==============================] - 1s 453us/step - loss: 8.2516e-04 - acc: 0.8318 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00062: val_loss did not improve
Epoch 63/80
1712/1712 [==============================] - 1s 441us/step - loss: 8.3090e-04 - acc: 0.8265 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00063: val_loss did not improve
Epoch 64/80
1712/1712 [==============================] - 1s 450us/step - loss: 8.2664e-04 - acc: 0.8312 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00064: val_loss improved from 0.00107 to 0.00105, saving model to my_model_Adamax.h5
Epoch 65/80
1712/1712 [==============================] - 1s 460us/step - loss: 8.0598e-04 - acc: 0.8224 - val_loss: 0.0010 - val_acc: 0.8037
Epoch 00065: val_loss improved from 0.00105 to 0.00103, saving model to my_model_Adamax.h5
Epoch 66/80
1712/1712 [==============================] - 1s 456us/step - loss: 8.0667e-04 - acc: 0.8283 - val_loss: 0.0010 - val_acc: 0.8107
Epoch 00066: val_loss did not improve
Epoch 67/80
1712/1712 [==============================] - 1s 448us/step - loss: 8.1768e-04 - acc: 0.8283 - val_loss: 0.0010 - val_acc: 0.8037
Epoch 00067: val_loss improved from 0.00103 to 0.00103, saving model to my_model_Adamax.h5
Epoch 68/80
1712/1712 [==============================] - 1s 444us/step - loss: 8.0812e-04 - acc: 0.8324 - val_loss: 0.0010 - val_acc: 0.8131
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 453us/step - loss: 7.8829e-04 - acc: 0.8353 - val_loss: 0.0010 - val_acc: 0.7944
Epoch 00069: val_loss improved from 0.00103 to 0.00102, saving model to my_model_Adamax.h5
Epoch 70/80
1712/1712 [==============================] - 1s 448us/step - loss: 7.9078e-04 - acc: 0.8300 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00070: val_loss did not improve
Epoch 71/80
1712/1712 [==============================] - 1s 437us/step - loss: 7.7844e-04 - acc: 0.8300 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00071: val_loss did not improve
Epoch 72/80
1712/1712 [==============================] - 1s 465us/step - loss: 7.5673e-04 - acc: 0.8195 - val_loss: 0.0010 - val_acc: 0.8154
Epoch 00072: val_loss did not improve
Epoch 73/80
1712/1712 [==============================] - 1s 449us/step - loss: 7.3890e-04 - acc: 0.8458 - val_loss: 0.0011 - val_acc: 0.8084
Epoch 00073: val_loss did not improve
Epoch 74/80
1712/1712 [==============================] - 1s 452us/step - loss: 7.7839e-04 - acc: 0.8347 - val_loss: 0.0010 - val_acc: 0.8178
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 448us/step - loss: 7.1769e-04 - acc: 0.8464 - val_loss: 0.0010 - val_acc: 0.8154
Epoch 00075: val_loss did not improve
Epoch 76/80
1712/1712 [==============================] - 1s 447us/step - loss: 7.3144e-04 - acc: 0.8458 - val_loss: 0.0010 - val_acc: 0.7757
Epoch 00076: val_loss did not improve
Epoch 77/80
1712/1712 [==============================] - 1s 445us/step - loss: 7.0665e-04 - acc: 0.8294 - val_loss: 0.0010 - val_acc: 0.8037
Epoch 00077: val_loss did not improve
Epoch 78/80
1712/1712 [==============================] - 1s 448us/step - loss: 6.9563e-04 - acc: 0.8446 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00078: val_loss did not improve
Epoch 79/80
1712/1712 [==============================] - 1s 462us/step - loss: 6.8829e-04 - acc: 0.8516 - val_loss: 0.0010 - val_acc: 0.8014
Epoch 00079: val_loss improved from 0.00102 to 0.00101, saving model to my_model_Adamax.h5
Epoch 80/80
1712/1712 [==============================] - 1s 437us/step - loss: 6.9024e-04 - acc: 0.8475 - val_loss: 0.0010 - val_acc: 0.8084
Epoch 00080: val_loss did not improve
------------------->Evaluating Nadam <----------------------------------------
-----------------------------------------------------------------------------
Train on 1712 samples, validate on 428 samples
Epoch 1/80
1712/1712 [==============================] - 2s 1ms/step - loss: 0.0236 - acc: 0.4574 - val_loss: 0.0044 - val_acc: 0.6963
Epoch 00001: val_loss improved from inf to 0.00442, saving model to my_model_Nadam.h5
Epoch 2/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0085 - acc: 0.6057 - val_loss: 0.0062 - val_acc: 0.6963
Epoch 00002: val_loss did not improve
Epoch 3/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0071 - acc: 0.6314 - val_loss: 0.0039 - val_acc: 0.7009
Epoch 00003: val_loss improved from 0.00442 to 0.00390, saving model to my_model_Nadam.h5
Epoch 4/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0057 - acc: 0.6536 - val_loss: 0.0035 - val_acc: 0.7009
Epoch 00004: val_loss improved from 0.00390 to 0.00354, saving model to my_model_Nadam.h5
Epoch 5/80
1712/1712 [==============================] - 1s 490us/step - loss: 0.0050 - acc: 0.6746 - val_loss: 0.0031 - val_acc: 0.7150
Epoch 00005: val_loss improved from 0.00354 to 0.00306, saving model to my_model_Nadam.h5
Epoch 6/80
1712/1712 [==============================] - 1s 469us/step - loss: 0.0043 - acc: 0.6682 - val_loss: 0.0029 - val_acc: 0.6986
Epoch 00006: val_loss improved from 0.00306 to 0.00290, saving model to my_model_Nadam.h5
Epoch 7/80
1712/1712 [==============================] - 1s 479us/step - loss: 0.0036 - acc: 0.7167 - val_loss: 0.0026 - val_acc: 0.7173
Epoch 00007: val_loss improved from 0.00290 to 0.00259, saving model to my_model_Nadam.h5
Epoch 8/80
1712/1712 [==============================] - 1s 494us/step - loss: 0.0032 - acc: 0.7056 - val_loss: 0.0030 - val_acc: 0.7313
Epoch 00008: val_loss did not improve
Epoch 9/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0029 - acc: 0.7249 - val_loss: 0.0023 - val_acc: 0.7313
Epoch 00009: val_loss improved from 0.00259 to 0.00231, saving model to my_model_Nadam.h5
Epoch 10/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0027 - acc: 0.7249 - val_loss: 0.0019 - val_acc: 0.7266
Epoch 00010: val_loss improved from 0.00231 to 0.00193, saving model to my_model_Nadam.h5
Epoch 11/80
1712/1712 [==============================] - 1s 487us/step - loss: 0.0024 - acc: 0.7377 - val_loss: 0.0018 - val_acc: 0.7266
Epoch 00011: val_loss improved from 0.00193 to 0.00180, saving model to my_model_Nadam.h5
Epoch 12/80
1712/1712 [==============================] - 1s 482us/step - loss: 0.0021 - acc: 0.7442 - val_loss: 0.0016 - val_acc: 0.7360
Epoch 00012: val_loss improved from 0.00180 to 0.00164, saving model to my_model_Nadam.h5
Epoch 13/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0021 - acc: 0.7436 - val_loss: 0.0017 - val_acc: 0.7290
Epoch 00013: val_loss did not improve
Epoch 14/80
1712/1712 [==============================] - 1s 482us/step - loss: 0.0019 - acc: 0.7430 - val_loss: 0.0019 - val_acc: 0.7407
Epoch 00014: val_loss did not improve
Epoch 15/80
1712/1712 [==============================] - 1s 471us/step - loss: 0.0018 - acc: 0.7716 - val_loss: 0.0016 - val_acc: 0.7313
Epoch 00015: val_loss improved from 0.00164 to 0.00160, saving model to my_model_Nadam.h5
Epoch 16/80
1712/1712 [==============================] - 1s 478us/step - loss: 0.0017 - acc: 0.7669 - val_loss: 0.0014 - val_acc: 0.7500
Epoch 00016: val_loss improved from 0.00160 to 0.00145, saving model to my_model_Nadam.h5
Epoch 17/80
1712/1712 [==============================] - 1s 490us/step - loss: 0.0015 - acc: 0.7775 - val_loss: 0.0014 - val_acc: 0.7757
Epoch 00017: val_loss improved from 0.00145 to 0.00139, saving model to my_model_Nadam.h5
Epoch 18/80
1712/1712 [==============================] - 1s 486us/step - loss: 0.0015 - acc: 0.7798 - val_loss: 0.0015 - val_acc: 0.7780
Epoch 00018: val_loss did not improve
Epoch 19/80
1712/1712 [==============================] - 1s 474us/step - loss: 0.0015 - acc: 0.7804 - val_loss: 0.0013 - val_acc: 0.7687
Epoch 00019: val_loss improved from 0.00139 to 0.00134, saving model to my_model_Nadam.h5
Epoch 20/80
1712/1712 [==============================] - 1s 472us/step - loss: 0.0014 - acc: 0.7833 - val_loss: 0.0013 - val_acc: 0.7850
Epoch 00020: val_loss improved from 0.00134 to 0.00133, saving model to my_model_Nadam.h5
Epoch 21/80
1712/1712 [==============================] - 1s 488us/step - loss: 0.0013 - acc: 0.7833 - val_loss: 0.0013 - val_acc: 0.7827
Epoch 00021: val_loss improved from 0.00133 to 0.00126, saving model to my_model_Nadam.h5
Epoch 22/80
1712/1712 [==============================] - 1s 466us/step - loss: 0.0013 - acc: 0.7827 - val_loss: 0.0013 - val_acc: 0.7593
Epoch 00022: val_loss did not improve
Epoch 23/80
1712/1712 [==============================] - 1s 473us/step - loss: 0.0013 - acc: 0.7944 - val_loss: 0.0013 - val_acc: 0.7944
Epoch 00023: val_loss did not improve
Epoch 24/80
1712/1712 [==============================] - 1s 489us/step - loss: 0.0012 - acc: 0.7956 - val_loss: 0.0013 - val_acc: 0.7967
Epoch 00024: val_loss did not improve
Epoch 25/80
1712/1712 [==============================] - 1s 476us/step - loss: 0.0012 - acc: 0.8102 - val_loss: 0.0015 - val_acc: 0.7897
Epoch 00025: val_loss did not improve
Epoch 26/80
1712/1712 [==============================] - 1s 487us/step - loss: 0.0011 - acc: 0.8160 - val_loss: 0.0012 - val_acc: 0.7967
Epoch 00026: val_loss improved from 0.00126 to 0.00122, saving model to my_model_Nadam.h5
Epoch 27/80
1712/1712 [==============================] - 1s 481us/step - loss: 0.0011 - acc: 0.8137 - val_loss: 0.0012 - val_acc: 0.7944
Epoch 00027: val_loss did not improve
Epoch 28/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0011 - acc: 0.8049 - val_loss: 0.0012 - val_acc: 0.7921
Epoch 00028: val_loss improved from 0.00122 to 0.00120, saving model to my_model_Nadam.h5
Epoch 29/80
1712/1712 [==============================] - 1s 475us/step - loss: 0.0011 - acc: 0.8201 - val_loss: 0.0015 - val_acc: 0.7967
Epoch 00029: val_loss did not improve
Epoch 30/80
1712/1712 [==============================] - 1s 477us/step - loss: 0.0011 - acc: 0.8148 - val_loss: 0.0012 - val_acc: 0.7874
Epoch 00030: val_loss improved from 0.00120 to 0.00118, saving model to my_model_Nadam.h5
Epoch 31/80
1712/1712 [==============================] - 1s 483us/step - loss: 0.0010 - acc: 0.8195 - val_loss: 0.0011 - val_acc: 0.8084
Epoch 00031: val_loss improved from 0.00118 to 0.00114, saving model to my_model_Nadam.h5
Epoch 32/80
1712/1712 [==============================] - 1s 477us/step - loss: 9.8015e-04 - acc: 0.8078 - val_loss: 0.0012 - val_acc: 0.7874
Epoch 00032: val_loss did not improve
Epoch 33/80
1712/1712 [==============================] - 1s 479us/step - loss: 9.5360e-04 - acc: 0.8213 - val_loss: 0.0011 - val_acc: 0.8084
Epoch 00033: val_loss improved from 0.00114 to 0.00113, saving model to my_model_Nadam.h5
Epoch 34/80
1712/1712 [==============================] - 1s 489us/step - loss: 9.3557e-04 - acc: 0.8131 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00034: val_loss improved from 0.00113 to 0.00113, saving model to my_model_Nadam.h5
Epoch 35/80
1712/1712 [==============================] - 1s 483us/step - loss: 9.4645e-04 - acc: 0.8207 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00035: val_loss did not improve
Epoch 36/80
1712/1712 [==============================] - 1s 482us/step - loss: 9.1896e-04 - acc: 0.8213 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00036: val_loss did not improve
Epoch 37/80
1712/1712 [==============================] - 1s 470us/step - loss: 9.0032e-04 - acc: 0.8254 - val_loss: 0.0012 - val_acc: 0.8014
Epoch 00037: val_loss did not improve
Epoch 38/80
1712/1712 [==============================] - 1s 474us/step - loss: 9.0239e-04 - acc: 0.8189 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00038: val_loss improved from 0.00113 to 0.00110, saving model to my_model_Nadam.h5
Epoch 39/80
1712/1712 [==============================] - 1s 481us/step - loss: 8.8598e-04 - acc: 0.8388 - val_loss: 0.0011 - val_acc: 0.8084
Epoch 00039: val_loss improved from 0.00110 to 0.00110, saving model to my_model_Nadam.h5
Epoch 40/80
1712/1712 [==============================] - 1s 469us/step - loss: 8.9105e-04 - acc: 0.8347 - val_loss: 0.0012 - val_acc: 0.7921
Epoch 00040: val_loss did not improve
Epoch 41/80
1712/1712 [==============================] - 1s 489us/step - loss: 8.7642e-04 - acc: 0.8259 - val_loss: 0.0012 - val_acc: 0.7967
Epoch 00041: val_loss did not improve
Epoch 42/80
1712/1712 [==============================] - 1s 486us/step - loss: 8.3955e-04 - acc: 0.8259 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00042: val_loss did not improve
Epoch 43/80
1712/1712 [==============================] - 1s 482us/step - loss: 8.5331e-04 - acc: 0.8324 - val_loss: 0.0012 - val_acc: 0.7967
Epoch 00043: val_loss did not improve
Epoch 44/80
1712/1712 [==============================] - 1s 481us/step - loss: 8.0989e-04 - acc: 0.8335 - val_loss: 0.0012 - val_acc: 0.8037
Epoch 00044: val_loss did not improve
Epoch 45/80
1712/1712 [==============================] - 1s 488us/step - loss: 8.2657e-04 - acc: 0.8318 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00045: val_loss did not improve
Epoch 46/80
1712/1712 [==============================] - 1s 467us/step - loss: 8.0413e-04 - acc: 0.8306 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00046: val_loss did not improve
Epoch 47/80
1712/1712 [==============================] - 1s 473us/step - loss: 8.0957e-04 - acc: 0.8300 - val_loss: 0.0012 - val_acc: 0.7991
Epoch 00047: val_loss did not improve
Epoch 48/80
1712/1712 [==============================] - 1s 479us/step - loss: 8.0088e-04 - acc: 0.8277 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00048: val_loss improved from 0.00110 to 0.00110, saving model to my_model_Nadam.h5
Epoch 49/80
1712/1712 [==============================] - 1s 473us/step - loss: 7.9929e-04 - acc: 0.8499 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00049: val_loss did not improve
Epoch 50/80
1712/1712 [==============================] - 1s 486us/step - loss: 8.0726e-04 - acc: 0.8364 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00050: val_loss improved from 0.00110 to 0.00109, saving model to my_model_Nadam.h5
Epoch 51/80
1712/1712 [==============================] - 1s 484us/step - loss: 7.8013e-04 - acc: 0.8446 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00051: val_loss did not improve
Epoch 52/80
1712/1712 [==============================] - 1s 487us/step - loss: 7.7963e-04 - acc: 0.8440 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00052: val_loss did not improve
Epoch 53/80
1712/1712 [==============================] - 1s 490us/step - loss: 7.7476e-04 - acc: 0.8347 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00053: val_loss did not improve
Epoch 54/80
1712/1712 [==============================] - 1s 471us/step - loss: 7.5096e-04 - acc: 0.8376 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00054: val_loss improved from 0.00109 to 0.00108, saving model to my_model_Nadam.h5
Epoch 55/80
1712/1712 [==============================] - 1s 482us/step - loss: 7.7481e-04 - acc: 0.8259 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00055: val_loss did not improve
Epoch 56/80
1712/1712 [==============================] - 1s 481us/step - loss: 7.7558e-04 - acc: 0.8388 - val_loss: 0.0011 - val_acc: 0.8014
Epoch 00056: val_loss did not improve
Epoch 57/80
1712/1712 [==============================] - 1s 487us/step - loss: 7.2524e-04 - acc: 0.8277 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00057: val_loss did not improve
Epoch 58/80
1712/1712 [==============================] - 1s 500us/step - loss: 7.7656e-04 - acc: 0.8429 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00058: val_loss did not improve
Epoch 59/80
1712/1712 [==============================] - 1s 480us/step - loss: 7.7039e-04 - acc: 0.8417 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00059: val_loss did not improve
Epoch 60/80
1712/1712 [==============================] - 1s 485us/step - loss: 7.4279e-04 - acc: 0.8440 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00060: val_loss did not improve
Epoch 61/80
1712/1712 [==============================] - 1s 480us/step - loss: 7.3071e-04 - acc: 0.8464 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00061: val_loss did not improve
Epoch 62/80
1712/1712 [==============================] - 1s 488us/step - loss: 7.0769e-04 - acc: 0.8440 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00062: val_loss improved from 0.00108 to 0.00107, saving model to my_model_Nadam.h5
Epoch 63/80
1712/1712 [==============================] - 1s 486us/step - loss: 7.3945e-04 - acc: 0.8364 - val_loss: 0.0010 - val_acc: 0.8061
Epoch 00063: val_loss improved from 0.00107 to 0.00104, saving model to my_model_Nadam.h5
Epoch 64/80
1712/1712 [==============================] - 1s 475us/step - loss: 6.7846e-04 - acc: 0.8446 - val_loss: 0.0011 - val_acc: 0.7827
Epoch 00064: val_loss did not improve
Epoch 65/80
1712/1712 [==============================] - 1s 477us/step - loss: 7.0454e-04 - acc: 0.8318 - val_loss: 0.0011 - val_acc: 0.7991
Epoch 00065: val_loss did not improve
Epoch 66/80
1712/1712 [==============================] - 1s 475us/step - loss: 7.2514e-04 - acc: 0.8452 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00066: val_loss did not improve
Epoch 67/80
1712/1712 [==============================] - 1s 481us/step - loss: 6.9667e-04 - acc: 0.8429 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00067: val_loss did not improve
Epoch 68/80
1712/1712 [==============================] - 1s 482us/step - loss: 6.9676e-04 - acc: 0.8551 - val_loss: 0.0011 - val_acc: 0.8084
Epoch 00068: val_loss did not improve
Epoch 69/80
1712/1712 [==============================] - 1s 463us/step - loss: 7.2338e-04 - acc: 0.8481 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00069: val_loss did not improve
Epoch 70/80
1712/1712 [==============================] - 1s 477us/step - loss: 7.2416e-04 - acc: 0.8493 - val_loss: 0.0011 - val_acc: 0.8037
Epoch 00070: val_loss did not improve
Epoch 71/80
1712/1712 [==============================] - 1s 485us/step - loss: 6.9108e-04 - acc: 0.8423 - val_loss: 0.0010 - val_acc: 0.7967
Epoch 00071: val_loss improved from 0.00104 to 0.00103, saving model to my_model_Nadam.h5
Epoch 72/80
1712/1712 [==============================] - 1s 471us/step - loss: 6.6994e-04 - acc: 0.8534 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00072: val_loss did not improve
Epoch 73/80
1712/1712 [==============================] - 1s 487us/step - loss: 6.8479e-04 - acc: 0.8546 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00073: val_loss did not improve
Epoch 74/80
1712/1712 [==============================] - 1s 485us/step - loss: 7.0012e-04 - acc: 0.8481 - val_loss: 0.0011 - val_acc: 0.7897
Epoch 00074: val_loss did not improve
Epoch 75/80
1712/1712 [==============================] - 1s 475us/step - loss: 7.0593e-04 - acc: 0.8546 - val_loss: 0.0011 - val_acc: 0.8154
Epoch 00075: val_loss did not improve
Epoch 76/80
1712/1712 [==============================] - 1s 478us/step - loss: 6.6173e-04 - acc: 0.8516 - val_loss: 0.0011 - val_acc: 0.7967
Epoch 00076: val_loss did not improve
Epoch 77/80
1712/1712 [==============================] - 1s 481us/step - loss: 7.0473e-04 - acc: 0.8522 - val_loss: 0.0011 - val_acc: 0.7944
Epoch 00077: val_loss did not improve
Epoch 78/80
1712/1712 [==============================] - 1s 475us/step - loss: 6.9478e-04 - acc: 0.8435 - val_loss: 0.0011 - val_acc: 0.7874
Epoch 00078: val_loss did not improve
Epoch 79/80
1712/1712 [==============================] - 1s 474us/step - loss: 6.6658e-04 - acc: 0.8475 - val_loss: 0.0011 - val_acc: 0.7921
Epoch 00079: val_loss did not improve
Epoch 80/80
1712/1712 [==============================] - 1s 480us/step - loss: 6.7387e-04 - acc: 0.8540 - val_loss: 0.0011 - val_acc: 0.7734
Epoch 00080: val_loss did not improve